Diagnosed failure

SlowTabletBootstrapTest.TestFallBehindSlowBootstrap: /home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/raft_config_change-itest.cc:500: Failure
Value of: IsRaftConfigMember(added_replica_uuid, cstate.committed_config())
  Actual: false
Expected: true
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20261118 03:03:31.050331 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17385
I20261118 03:03:31.055728 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17942
I20261118 03:03:31.061204 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17647
I20261118 03:03:31.066637 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17778
I20261118 03:03:31.072268 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17294
2026-11-18T03:03:31Z chronyd exiting
I20261118 03:03:31.088557 13673 test_util.cc:182] -----------------------------------------------
I20261118 03:03:31.088613 13673 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0

Full log

[==========] Running 6 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 3 tests from RaftConfigChangeITest
[ RUN      ] RaftConfigChangeITest.TestKudu2147
2026-11-18T03:02:28Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:28Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20261118 03:02:28.909201 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:41087
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:41087 with env {}
W20261118 03:02:29.009004 13681 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:29.009193 13681 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:29.009232 13681 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:29.012612 13681 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:29.012702 13681 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:29.012725 13681 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:29.012741 13681 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:29.016875 13681 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:41087
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:41087
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.13681
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:29.017696 13681 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:29.018410 13681 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:29.023759 13689 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.023825 13686 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.023788 13687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:29.024158 13681 server_base.cc:1061] running on GCE node
I20261118 03:02:29.024556 13681 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:29.025322 13681 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:29.026482 13681 hybrid_clock.cc:648] HybridClock initialized: now 1794970949026467 us; error 24 us; skew 500 ppm
I20261118 03:02:29.028133 13681 webserver.cc:577] Webserver started at http://127.13.90.126:34375/ using document root <none> and password file <none>
I20261118 03:02:29.028736 13681 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:29.028787 13681 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:29.028999 13681 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:29.030285 13681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data/instance:
uuid: "472e5d61a16e437d92ab2874a9adc30e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.030709 13681 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal/instance:
uuid: "472e5d61a16e437d92ab2874a9adc30e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.033857 13681 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 03:02:29.035992 13695 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.037050 13681 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:29.037205 13681 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal
uuid: "472e5d61a16e437d92ab2874a9adc30e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.037293 13681 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:29.066735 13681 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:29.067281 13681 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:29.067423 13681 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:29.074420 13681 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:41087
I20261118 03:02:29.074452 13747 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:41087 every 8 connection(s)
I20261118 03:02:29.075464 13681 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
I20261118 03:02:29.078835 13748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:29.083896 13748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e: Bootstrap starting.
I20261118 03:02:29.084916 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 13681
I20261118 03:02:29.085068 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/master-0/wal/instance
I20261118 03:02:29.086648 13748 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:29.087613 13748 log.cc:826] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:29.089236 13748 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e: No bootstrap required, opened a new log
I20261118 03:02:29.091856 13748 raft_consensus.cc:360] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } }
I20261118 03:02:29.092052 13748 raft_consensus.cc:386] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:29.092101 13748 raft_consensus.cc:748] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472e5d61a16e437d92ab2874a9adc30e, State: Initialized, Role: FOLLOWER
I20261118 03:02:29.092541 13748 consensus_queue.cc:261] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } }
I20261118 03:02:29.092717 13748 raft_consensus.cc:400] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:29.092813 13748 raft_consensus.cc:499] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:29.092885 13748 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:29.093645 13748 raft_consensus.cc:521] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } }
I20261118 03:02:29.094019 13748 leader_election.cc:304] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 472e5d61a16e437d92ab2874a9adc30e; no voters: 
I20261118 03:02:29.094293 13748 leader_election.cc:290] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:29.094422 13753 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:29.094712 13753 raft_consensus.cc:705] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [term 1 LEADER]: Becoming Leader. State: Replica: 472e5d61a16e437d92ab2874a9adc30e, State: Running, Role: LEADER
I20261118 03:02:29.095028 13753 consensus_queue.cc:238] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } }
I20261118 03:02:29.095366 13748 sys_catalog.cc:565] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:29.096441 13755 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 472e5d61a16e437d92ab2874a9adc30e. Latest consensus state: current_term: 1 leader_uuid: "472e5d61a16e437d92ab2874a9adc30e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } } }
I20261118 03:02:29.096550 13755 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:29.096805 13754 sys_catalog.cc:455] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "472e5d61a16e437d92ab2874a9adc30e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "472e5d61a16e437d92ab2874a9adc30e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 41087 } } }
I20261118 03:02:29.096884 13754 sys_catalog.cc:458] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:29.097725 13762 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:29.100548 13762 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:29.106294 13762 catalog_manager.cc:1398] Generated new cluster ID: 8ae964d2fd174fc8ab14c5ef0c517871
I20261118 03:02:29.106350 13762 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:29.125586 13762 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:29.126441 13762 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:29.138751 13762 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 472e5d61a16e437d92ab2874a9adc30e: Generated new TSK 0
I20261118 03:02:29.139366 13762 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:29.151515 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--builtin_ntp_servers=127.13.90.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
W20261118 03:02:29.251812 13772 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:29.251995 13772 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:29.252061 13772 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:29.255578 13772 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:29.255713 13772 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:29.259666 13772 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--never_fsync=true
--heap_profile_path=/tmp/kudu.13772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:29.260442 13772 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:29.261188 13772 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:29.266979 13780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.267014 13778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.267055 13777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:29.267223 13772 server_base.cc:1061] running on GCE node
I20261118 03:02:29.267643 13772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:29.268193 13772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:29.269352 13772 hybrid_clock.cc:648] HybridClock initialized: now 1794970949269333 us; error 36 us; skew 500 ppm
I20261118 03:02:29.270925 13772 webserver.cc:577] Webserver started at http://127.13.90.65:40423/ using document root <none> and password file <none>
I20261118 03:02:29.271510 13772 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:29.271562 13772 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:29.271770 13772 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:29.273105 13772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data/instance:
uuid: "17072381ebad4a2ca3ac0665a8d8fb1e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.273514 13772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance:
uuid: "17072381ebad4a2ca3ac0665a8d8fb1e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.276895 13772 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 03:02:29.279151 13786 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.280119 13772 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:29.280221 13772 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal
uuid: "17072381ebad4a2ca3ac0665a8d8fb1e"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.280304 13772 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:29.294485 13772 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:29.294922 13772 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:29.295054 13772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:29.295537 13772 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:29.296497 13772 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:29.296542 13772 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.296595 13772 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:29.296617 13772 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.304837 13772 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:46517
I20261118 03:02:29.304877 13899 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:46517 every 8 connection(s)
I20261118 03:02:29.305750 13772 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
I20261118 03:02:29.306447 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 13772
I20261118 03:02:29.306528 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance
I20261118 03:02:29.308801 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--builtin_ntp_servers=127.13.90.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
I20261118 03:02:29.314388 13900 heartbeater.cc:345] Connected to a master server at 127.13.90.126:41087
I20261118 03:02:29.314639 13900 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:29.315122 13900 heartbeater.cc:508] Master 127.13.90.126:41087 requested a full tablet report, sending...
I20261118 03:02:29.316764 13712 ts_manager.cc:210] Registered new tserver with Master: 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65:46517)
I20261118 03:02:29.317989 13712 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:58767
W20261118 03:02:29.409370 13903 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:29.409511 13903 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:29.409551 13903 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:29.412838 13903 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:29.412935 13903 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:29.416738 13903 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--never_fsync=true
--heap_profile_path=/tmp/kudu.13903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:29.417462 13903 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:29.418128 13903 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:29.423677 13909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:29.423705 13903 server_base.cc:1061] running on GCE node
W20261118 03:02:29.423736 13908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.423846 13911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:29.424305 13903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:29.424883 13903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:29.426070 13903 hybrid_clock.cc:648] HybridClock initialized: now 1794970949426057 us; error 27 us; skew 500 ppm
I20261118 03:02:29.427668 13903 webserver.cc:577] Webserver started at http://127.13.90.66:36167/ using document root <none> and password file <none>
I20261118 03:02:29.428259 13903 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:29.428309 13903 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:29.428517 13903 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:29.429826 13903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data/instance:
uuid: "12bd0e9d5b174bf09055835f3990481a"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.430243 13903 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance:
uuid: "12bd0e9d5b174bf09055835f3990481a"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.433416 13903 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 03:02:29.435760 13917 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.436851 13903 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:29.436965 13903 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal
uuid: "12bd0e9d5b174bf09055835f3990481a"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.437049 13903 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:29.456414 13903 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:29.456923 13903 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:29.457064 13903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:29.457589 13903 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:29.458564 13903 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:29.458612 13903 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.458668 13903 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:29.458698 13903 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.467657 13903 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:36675
I20261118 03:02:29.467695 14030 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:36675 every 8 connection(s)
I20261118 03:02:29.468679 13903 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
I20261118 03:02:29.474958 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 13903
I20261118 03:02:29.475083 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance
I20261118 03:02:29.476323 14031 heartbeater.cc:345] Connected to a master server at 127.13.90.126:41087
I20261118 03:02:29.476576 14031 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:29.477141 14031 heartbeater.cc:508] Master 127.13.90.126:41087 requested a full tablet report, sending...
I20261118 03:02:29.477492 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--builtin_ntp_servers=127.13.90.84:41601
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000 with env {}
I20261118 03:02:29.478250 13711 ts_manager.cc:210] Registered new tserver with Master: 12bd0e9d5b174bf09055835f3990481a (127.13.90.66:36675)
I20261118 03:02:29.478832 13711 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:50409
W20261118 03:02:29.577668 14034 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:29.577823 14034 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:29.577864 14034 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:29.581228 14034 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:29.581334 14034 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:29.585173 14034 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:41601
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_heartbeat_interval_ms=3000
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:41087
--never_fsync=true
--heap_profile_path=/tmp/kudu.14034
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:29.585922 14034 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:29.586627 14034 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:29.592203 14040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.592237 14042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:29.592233 14039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:29.592907 14034 server_base.cc:1061] running on GCE node
I20261118 03:02:29.593267 14034 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:29.593796 14034 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:29.594959 14034 hybrid_clock.cc:648] HybridClock initialized: now 1794970949594927 us; error 43 us; skew 500 ppm
I20261118 03:02:29.596783 14034 webserver.cc:577] Webserver started at http://127.13.90.67:45687/ using document root <none> and password file <none>
I20261118 03:02:29.597391 14034 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:29.597452 14034 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:29.597653 14034 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:29.598912 14034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data/instance:
uuid: "5a761e6150774b3ea290a3334b2fe836"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.599325 14034 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance:
uuid: "5a761e6150774b3ea290a3334b2fe836"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.602415 14034 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20261118 03:02:29.604674 14048 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.605734 14034 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:29.605840 14034 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal
uuid: "5a761e6150774b3ea290a3334b2fe836"
format_stamp: "Formatted at 2026-11-18 03:02:29 on dist-test-slave-m226"
I20261118 03:02:29.605926 14034 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:29.630097 14034 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:29.630595 14034 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:29.630735 14034 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:29.631277 14034 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:29.632279 14034 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:29.632326 14034 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.632382 14034 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:29.632412 14034 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:29.641317 14034 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:45399
I20261118 03:02:29.641361 14161 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:45399 every 8 connection(s)
I20261118 03:02:29.642283 14034 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
I20261118 03:02:29.643090 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14034
I20261118 03:02:29.643177 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance
I20261118 03:02:29.649755 14162 heartbeater.cc:345] Connected to a master server at 127.13.90.126:41087
I20261118 03:02:29.649960 14162 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:29.650403 14162 heartbeater.cc:508] Master 127.13.90.126:41087 requested a full tablet report, sending...
I20261118 03:02:29.651372 13711 ts_manager.cc:210] Registered new tserver with Master: 5a761e6150774b3ea290a3334b2fe836 (127.13.90.67:45399)
I20261118 03:02:29.651895 13711 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:54673
I20261118 03:02:29.657445 13673 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20261118 03:02:29.678869 13711 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34596:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20261118 03:02:29.680018 13711 catalog_manager.cc:7228] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20261118 03:02:29.696044 13965 tablet_service.cc:1500] Processing CreateTablet for tablet ba6be38fbca940a09ff324b4d14035c4 (DEFAULT_TABLE table=test-workload [id=eedef96b106545f5b7e26e625a4e2fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:29.696364 13834 tablet_service.cc:1500] Processing CreateTablet for tablet ba6be38fbca940a09ff324b4d14035c4 (DEFAULT_TABLE table=test-workload [id=eedef96b106545f5b7e26e625a4e2fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:29.696364 14096 tablet_service.cc:1500] Processing CreateTablet for tablet ba6be38fbca940a09ff324b4d14035c4 (DEFAULT_TABLE table=test-workload [id=eedef96b106545f5b7e26e625a4e2fb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:29.697062 13965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6be38fbca940a09ff324b4d14035c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:29.697317 14096 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6be38fbca940a09ff324b4d14035c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:29.697317 13834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6be38fbca940a09ff324b4d14035c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:29.702696 14184 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Bootstrap starting.
I20261118 03:02:29.703428 14185 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Bootstrap starting.
I20261118 03:02:29.704958 14184 tablet_bootstrap.cc:654] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:29.704998 14186 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Bootstrap starting.
I20261118 03:02:29.705497 14185 tablet_bootstrap.cc:654] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:29.705719 14184 log.cc:826] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:29.706326 14185 log.cc:826] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:29.707099 14186 tablet_bootstrap.cc:654] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:29.707120 14184 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: No bootstrap required, opened a new log
I20261118 03:02:29.707315 14184 ts_tablet_manager.cc:1449] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:29.707753 14185 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: No bootstrap required, opened a new log
I20261118 03:02:29.707909 14186 log.cc:826] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:29.707962 14185 ts_tablet_manager.cc:1449] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20261118 03:02:29.709371 14186 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: No bootstrap required, opened a new log
I20261118 03:02:29.709623 14186 ts_tablet_manager.cc:1449] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:29.710166 14184 raft_consensus.cc:360] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.710333 14184 raft_consensus.cc:386] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:29.710386 14184 raft_consensus.cc:748] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12bd0e9d5b174bf09055835f3990481a, State: Initialized, Role: FOLLOWER
I20261118 03:02:29.710759 14184 consensus_queue.cc:261] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.711009 14185 raft_consensus.cc:360] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.711378 14031 heartbeater.cc:500] Master 127.13.90.126:41087 was elected leader, sending a full tablet report...
I20261118 03:02:29.711517 14184 ts_tablet_manager.cc:1480] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:29.711251 14185 raft_consensus.cc:386] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:29.712535 14185 raft_consensus.cc:748] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a761e6150774b3ea290a3334b2fe836, State: Initialized, Role: FOLLOWER
I20261118 03:02:29.712700 14186 raft_consensus.cc:360] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.712957 14186 raft_consensus.cc:386] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:29.713054 14186 raft_consensus.cc:748] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17072381ebad4a2ca3ac0665a8d8fb1e, State: Initialized, Role: FOLLOWER
I20261118 03:02:29.712993 14185 consensus_queue.cc:261] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.713513 14186 consensus_queue.cc:261] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.713686 14162 heartbeater.cc:500] Master 127.13.90.126:41087 was elected leader, sending a full tablet report...
I20261118 03:02:29.713747 14185 ts_tablet_manager.cc:1480] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20261118 03:02:29.714214 14186 ts_tablet_manager.cc:1480] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:29.714623 13900 heartbeater.cc:500] Master 127.13.90.126:41087 was elected leader, sending a full tablet report...
W20261118 03:02:29.719419 14032 tablet.cc:2441] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:29.806788 13901 tablet.cc:2441] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:29.878527 14191 raft_consensus.cc:499] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:29.878731 14191 raft_consensus.cc:521] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.879956 14191 leader_election.cc:290] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12bd0e9d5b174bf09055835f3990481a (127.13.90.66:36675), 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65:46517)
I20261118 03:02:29.883749 13854 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4" candidate_uuid: "5a761e6150774b3ea290a3334b2fe836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" is_pre_election: true
I20261118 03:02:29.883780 13985 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4" candidate_uuid: "5a761e6150774b3ea290a3334b2fe836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12bd0e9d5b174bf09055835f3990481a" is_pre_election: true
I20261118 03:02:29.884024 13985 raft_consensus.cc:2490] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a761e6150774b3ea290a3334b2fe836 in term 0.
I20261118 03:02:29.884027 13854 raft_consensus.cc:2490] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5a761e6150774b3ea290a3334b2fe836 in term 0.
I20261118 03:02:29.884431 14049 leader_election.cc:304] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17072381ebad4a2ca3ac0665a8d8fb1e, 5a761e6150774b3ea290a3334b2fe836; no voters: 
I20261118 03:02:29.884645 14191 raft_consensus.cc:2826] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 03:02:29.884730 14191 raft_consensus.cc:499] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:29.884783 14191 raft_consensus.cc:3096] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:29.885649 14191 raft_consensus.cc:521] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.885990 14191 leader_election.cc:290] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [CANDIDATE]: Term 1 election: Requested vote from peers 12bd0e9d5b174bf09055835f3990481a (127.13.90.66:36675), 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65:46517)
I20261118 03:02:29.886288 13985 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4" candidate_uuid: "5a761e6150774b3ea290a3334b2fe836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12bd0e9d5b174bf09055835f3990481a"
I20261118 03:02:29.886309 13854 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4" candidate_uuid: "5a761e6150774b3ea290a3334b2fe836" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e"
I20261118 03:02:29.886402 13854 raft_consensus.cc:3096] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:29.886402 13985 raft_consensus.cc:3096] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:29.887483 13985 raft_consensus.cc:2490] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a761e6150774b3ea290a3334b2fe836 in term 1.
I20261118 03:02:29.887773 14052 leader_election.cc:304] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12bd0e9d5b174bf09055835f3990481a, 5a761e6150774b3ea290a3334b2fe836; no voters: 
I20261118 03:02:29.887826 13854 raft_consensus.cc:2490] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5a761e6150774b3ea290a3334b2fe836 in term 1.
I20261118 03:02:29.887980 14191 raft_consensus.cc:2826] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:29.888192 14191 raft_consensus.cc:705] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 LEADER]: Becoming Leader. State: Replica: 5a761e6150774b3ea290a3334b2fe836, State: Running, Role: LEADER
I20261118 03:02:29.888496 14191 consensus_queue.cc:238] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:29.891805 14194 consensus_queue.cc:1049] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:29.891970 14191 consensus_queue.cc:1049] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:29.891911 13710 catalog_manager.cc:5840] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5a761e6150774b3ea290a3334b2fe836 (127.13.90.67). New cstate: current_term: 1 leader_uuid: "5a761e6150774b3ea290a3334b2fe836" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 46517 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } health_report { overall_health: HEALTHY } } }
W20261118 03:02:29.893379 14163 tablet.cc:2441] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:30.012146 13894 generic_service.cc:139] {username='slave'} at 127.0.0.1:57762 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 03:02:30.012265 13894 generic_service.cc:175] {username='slave'} at 127.0.0.1:57762 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 03:02:30.013269 13894 generic_service.cc:175] {username='slave'} at 127.0.0.1:57762 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '5000'
W20261118 03:02:30.014254 14025 generic_service.cc:139] {username='slave'} at 127.0.0.1:47412 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 03:02:30.014358 14025 generic_service.cc:175] {username='slave'} at 127.0.0.1:47412 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 03:02:30.015148 14025 generic_service.cc:175] {username='slave'} at 127.0.0.1:47412 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '5000'
W20261118 03:02:30.016010 14156 generic_service.cc:139] {username='slave'} at 127.0.0.1:54480 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 03:02:30.016141 14156 generic_service.cc:175] {username='slave'} at 127.0.0.1:54480 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'false'
I20261118 03:02:30.016985 14156 generic_service.cc:175] {username='slave'} at 127.0.0.1:54480 changed flags via RPC: heartbeat_inject_latency_before_heartbeat_ms from '0' to '2000'
I20261118 03:02:30.018378 14116 consensus_queue.cc:238] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:30.019408 13984 raft_consensus.cc:1285] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 1 FOLLOWER]: Refusing update from remote peer 5a761e6150774b3ea290a3334b2fe836: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 1 index: 16. (index mismatch)
I20261118 03:02:30.019738 14194 consensus_queue.cc:1049] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20261118 03:02:30.021332 14191 raft_consensus.cc:2983] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 LEADER]: Committing config change with OpId 1.16: config changed from index -1 to 16, VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } }
I20261118 03:02:30.021732 13984 raft_consensus.cc:2983] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 1 FOLLOWER]: Committing config change with OpId 1.16: config changed from index -1 to 16, VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } }
W20261118 03:02:30.023326 14156 generic_service.cc:139] {username='slave'} at 127.0.0.1:54480 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 03:02:30.023384 14156 generic_service.cc:175] {username='slave'} at 127.0.0.1:54480 changed flags via RPC: follower_reject_update_consensus_requests from 'false' to 'true'
I20261118 03:02:30.024055 13984 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4"
dest_uuid: "12bd0e9d5b174bf09055835f3990481a"
 from {username='slave'} at 127.0.0.1:47412
I20261118 03:02:30.024173 13984 raft_consensus.cc:499] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20261118 03:02:30.024235 13984 raft_consensus.cc:3096] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:30.024920 13984 raft_consensus.cc:521] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:30.025744 13984 leader_election.cc:290] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [CANDIDATE]: Term 2 election: Requested vote from peers 5a761e6150774b3ea290a3334b2fe836 (127.13.90.67:45399)
I20261118 03:02:30.029356 14116 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "ba6be38fbca940a09ff324b4d14035c4" candidate_uuid: "12bd0e9d5b174bf09055835f3990481a" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: true dest_uuid: "5a761e6150774b3ea290a3334b2fe836"
I20261118 03:02:30.029511 14116 raft_consensus.cc:3091] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 LEADER]: Stepping down as leader of term 1
I20261118 03:02:30.029551 14116 raft_consensus.cc:748] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5a761e6150774b3ea290a3334b2fe836, State: Running, Role: LEADER
I20261118 03:02:30.029717 14116 consensus_queue.cc:261] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
I20261118 03:02:30.029840 14116 raft_consensus.cc:3096] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:30.030560 14116 raft_consensus.cc:2490] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12bd0e9d5b174bf09055835f3990481a in term 2.
I20261118 03:02:30.030929 13918 leader_election.cc:304] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 2 voters: 2 yes votes; 0 no votes. yes voters: 12bd0e9d5b174bf09055835f3990481a, 5a761e6150774b3ea290a3334b2fe836; no voters: 
I20261118 03:02:30.031185 14190 raft_consensus.cc:2826] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 2 FOLLOWER]: Leader election won for term 2
I20261118 03:02:30.031371 14190 raft_consensus.cc:705] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 2 LEADER]: Becoming Leader. State: Replica: 12bd0e9d5b174bf09055835f3990481a, State: Running, Role: LEADER
I20261118 03:02:30.031688 14190 consensus_queue.cc:238] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } }
W20261118 03:02:30.033632 13918 consensus_peers.cc:597] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a -> Peer 5a761e6150774b3ea290a3334b2fe836 (127.13.90.67:45399): Couldn't send request to peer 5a761e6150774b3ea290a3334b2fe836. Error code: UNKNOWN_ERROR (1). Status: Illegal state: Rejected: --follower_reject_update_consensus_requests is set to true.. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:32.024183 13708 catalog_manager.cc:5840] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 reported cstate change: config changed from index -1 to 16, term changed from 1 to 2, leader changed from 5a761e6150774b3ea290a3334b2fe836 (127.13.90.67) to <none>, VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) evicted. New cstate: current_term: 2 committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } }
I20261118 03:02:32.027644 13834 tablet_service.cc:1547] Processing DeleteTablet for tablet ba6be38fbca940a09ff324b4d14035c4 with delete_type TABLET_DATA_TOMBSTONED (TS 17072381ebad4a2ca3ac0665a8d8fb1e not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:57746
I20261118 03:02:32.028177 14225 tablet_replica.cc:333] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: stopping tablet replica
I20261118 03:02:32.028436 14225 raft_consensus.cc:2261] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 1 FOLLOWER]: Raft consensus shutting down.
I20261118 03:02:32.028693 14225 raft_consensus.cc:2290] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 1 FOLLOWER]: Raft consensus is shut down!
I20261118 03:02:32.029711 14225 ts_tablet_manager.cc:1962] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20261118 03:02:32.031700 14225 ts_tablet_manager.cc:1975] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.15
I20261118 03:02:32.031781 14225 log.cc:1199] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Deleting WAL directory at /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestKudu2147.1794970948883749-13673-0/minicluster-data/ts-0/wal/wals/ba6be38fbca940a09ff324b4d14035c4
I20261118 03:02:32.032362 13696 catalog_manager.cc:5065] TS 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65:46517): tablet ba6be38fbca940a09ff324b4d14035c4 (table test-workload [id=eedef96b106545f5b7e26e625a4e2fb9]) successfully deleted
W20261118 03:02:32.068347 14156 generic_service.cc:139] {username='slave'} at 127.0.0.1:54480 forcing change of non-runtime-safe flag follower_reject_update_consensus_requests
I20261118 03:02:32.068461 14156 generic_service.cc:175] {username='slave'} at 127.0.0.1:54480 changed flags via RPC: follower_reject_update_consensus_requests from 'true' to 'false'
I20261118 03:02:32.071439 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:32.174260 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:32.377017 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:32.679801 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:33.082842 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:33.585832 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 1.16 <uninitialized op>
I20261118 03:02:34.029044 13708 catalog_manager.cc:5840] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 reported cstate change: leader changed from <none> to 12bd0e9d5b174bf09055835f3990481a (127.13.90.66). New cstate: current_term: 2 leader_uuid: "12bd0e9d5b174bf09055835f3990481a" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } }
I20261118 03:02:34.188840 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 2.17 <uninitialized op>
I20261118 03:02:34.891652 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.17 2.17 <uninitialized op>
I20261118 03:02:35.027012 13984 consensus_queue.cc:238] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } }
I20261118 03:02:35.028839 14116 raft_consensus.cc:1285] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 2 FOLLOWER]: Refusing update from remote peer 12bd0e9d5b174bf09055835f3990481a: Log matching property violated. Preceding OpId in replica: term: 2 index: 17. Preceding OpId from leader: term: 2 index: 18. (index mismatch)
I20261118 03:02:35.029367 14239 consensus_queue.cc:1049] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20261118 03:02:35.031585 14239 raft_consensus.cc:2983] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a [term 2 LEADER]: Committing config change with OpId 2.18: config changed from index 16 to 18, NON_VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } } }
I20261118 03:02:35.031941 14116 raft_consensus.cc:2983] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 [term 2 FOLLOWER]: Committing config change with OpId 2.18: config changed from index 16 to 18, NON_VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) added. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } } }
W20261118 03:02:35.032824 13918 consensus_peers.cc:597] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a -> Peer 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65:46517): Couldn't send request to peer 17072381ebad4a2ca3ac0665a8d8fb1e. Error code: TABLET_NOT_FOUND (6). Status: Illegal state: Tablet not RUNNING: STOPPED. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:35.033159 13699 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet ba6be38fbca940a09ff324b4d14035c4 with cas_config_opid_index 16: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261118 03:02:35.694437 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.18 2.18 <uninitialized op>
I20261118 03:02:36.033440 13708 catalog_manager.cc:5840] T ba6be38fbca940a09ff324b4d14035c4 P 5a761e6150774b3ea290a3334b2fe836 reported cstate change: config changed from index 16 to 18, NON_VOTER 17072381ebad4a2ca3ac0665a8d8fb1e (127.13.90.65) added. New cstate: current_term: 2 leader_uuid: "12bd0e9d5b174bf09055835f3990481a" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } } }
I20261118 03:02:36.597095 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.18 2.18 <uninitialized op>
I20261118 03:02:37.583353 14250 ts_tablet_manager.cc:979] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Initiating tablet copy from peer 12bd0e9d5b174bf09055835f3990481a (127.13.90.66:36675)
I20261118 03:02:37.583935 14250 tablet_copy_client.cc:323] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet copy: Beginning tablet copy session from remote peer at address 127.13.90.66:36675
I20261118 03:02:37.587466 14005 tablet_copy_service.cc:140] P 12bd0e9d5b174bf09055835f3990481a: Received BeginTabletCopySession request for tablet ba6be38fbca940a09ff324b4d14035c4 from peer 17072381ebad4a2ca3ac0665a8d8fb1e ({username='slave'} at 127.13.90.65:45075)
I20261118 03:02:37.587585 14005 tablet_copy_service.cc:161] P 12bd0e9d5b174bf09055835f3990481a: Beginning new tablet copy session on tablet ba6be38fbca940a09ff324b4d14035c4 from peer 17072381ebad4a2ca3ac0665a8d8fb1e at {username='slave'} at 127.13.90.65:45075: session id = 17072381ebad4a2ca3ac0665a8d8fb1e-ba6be38fbca940a09ff324b4d14035c4
I20261118 03:02:37.588842 14005 tablet_copy_source_session.cc:215] T ba6be38fbca940a09ff324b4d14035c4 P 12bd0e9d5b174bf09055835f3990481a: Tablet Copy: opened 0 blocks and 1 log segments
I20261118 03:02:37.590169 14250 ts_tablet_manager.cc:1962] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Deleting tablet data with delete state TABLET_DATA_COPYING
I20261118 03:02:37.591820 14250 ts_tablet_manager.cc:1975] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.15
I20261118 03:02:37.591988 14250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba6be38fbca940a09ff324b4d14035c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:37.593072 14250 tablet_copy_client.cc:806] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet copy: Starting download of 0 data blocks...
I20261118 03:02:37.593210 14250 tablet_copy_client.cc:670] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet copy: Starting download of 1 WAL segments...
I20261118 03:02:37.594941 14250 tablet_copy_client.cc:538] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 03:02:37.596354 14250 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Bootstrap starting.
I20261118 03:02:37.599689 13673 cluster_itest_util.cc:258] Not converged past 1 yet: 2.18 2.18 <uninitialized op>
I20261118 03:02:37.621760 14250 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Bootstrap replayed 1/1 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=0} inserts{seen=700 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 03:02:37.622048 14250 tablet_bootstrap.cc:492] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Bootstrap complete.
I20261118 03:02:37.622221 14250 ts_tablet_manager.cc:1449] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Time spent bootstrapping tablet: real 0.026s	user 0.023s	sys 0.002s
I20261118 03:02:37.622665 14250 raft_consensus.cc:360] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } }
I20261118 03:02:37.622769 14250 raft_consensus.cc:748] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 17072381ebad4a2ca3ac0665a8d8fb1e, State: Initialized, Role: LEARNER
I20261118 03:02:37.622874 14250 consensus_queue.cc:261] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 18, Last appended: 2.18, Last appended by leader: 18, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "12bd0e9d5b174bf09055835f3990481a" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36675 } } peers { permanent_uuid: "5a761e6150774b3ea290a3334b2fe836" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 45399 } } peers { permanent_uuid: "17072381ebad4a2ca3ac0665a8d8fb1e" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 46517 } attrs { promote: true } }
I20261118 03:02:37.623199 14250 ts_tablet_manager.cc:1480] T ba6be38fbca940a09ff324b4d14035c4 P 17072381ebad4a2ca3ac0665a8d8fb1e: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20261118 03:02:37.623883 14005 tablet_copy_service.cc:342] P 12bd0e9d5b174bf09055835f3990481a: Request end of tablet copy session 17072381ebad4a2ca3ac0665a8d8fb1e-ba6be38fbca940a09ff324b4d14035c4 received from {username='slave'} at 127.13.90.65:45075
I20261118 03:02:37.623982 14005 tablet_copy_service.cc:434] P 12bd0e9d5b174bf09055835f3990481a: ending tablet copy session 17072381ebad4a2ca3ac0665a8d8fb1e-ba6be38fbca940a09ff324b4d14035c4 on tablet ba6be38fbca940a09ff324b4d14035c4 with peer 17072381ebad4a2ca3ac0665a8d8fb1e
I20261118 03:02:38.603274 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 13772
I20261118 03:02:38.609709 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 13903
I20261118 03:02:38.616863 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14034
I20261118 03:02:38.621945 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 13681
2026-11-18T03:02:38Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestKudu2147 (9748 ms)
[ RUN      ] RaftConfigChangeITest.TestNonVoterPromotion
2026-11-18T03:02:38Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:38Z Disabled control of system clock
I20261118 03:02:38.649241 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:38281
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:38653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:38281
--raft_prepare_replacement_before_eviction=true
--catalog_manager_evict_excess_replicas=false with env {}
W20261118 03:02:38.747885 14259 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:38.748052 14259 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:38.748088 14259 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:38.751375 14259 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:38.751430 14259 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:38.751451 14259 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:38.751467 14259 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:38.755347 14259 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:38653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal
--catalog_manager_evict_excess_replicas=false
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:38281
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:38281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:38.756063 14259 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:38.756757 14259 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:38.761632 14264 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:38.761693 14259 server_base.cc:1061] running on GCE node
W20261118 03:02:38.761619 14265 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:38.761829 14267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:38.762215 14259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:38.762938 14259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:38.764099 14259 hybrid_clock.cc:648] HybridClock initialized: now 1794970958764079 us; error 30 us; skew 500 ppm
I20261118 03:02:38.765882 14259 webserver.cc:577] Webserver started at http://127.13.90.126:35335/ using document root <none> and password file <none>
I20261118 03:02:38.766433 14259 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:38.766484 14259 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:38.766695 14259 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:38.767992 14259 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data/instance:
uuid: "fe7dc91184324b76ae8e330a104eacda"
format_stamp: "Formatted at 2026-11-18 03:02:38 on dist-test-slave-m226"
I20261118 03:02:38.768410 14259 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal/instance:
uuid: "fe7dc91184324b76ae8e330a104eacda"
format_stamp: "Formatted at 2026-11-18 03:02:38 on dist-test-slave-m226"
I20261118 03:02:38.771493 14259 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20261118 03:02:38.773718 14273 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:38.774642 14259 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20261118 03:02:38.774768 14259 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal
uuid: "fe7dc91184324b76ae8e330a104eacda"
format_stamp: "Formatted at 2026-11-18 03:02:38 on dist-test-slave-m226"
I20261118 03:02:38.774850 14259 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:38.808528 14259 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:38.809060 14259 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:38.809201 14259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:38.815657 14259 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:38281
I20261118 03:02:38.815668 14325 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:38281 every 8 connection(s)
I20261118 03:02:38.816704 14259 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
I20261118 03:02:38.819759 14326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:38.823843 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14259
I20261118 03:02:38.824050 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/master-0/wal/instance
I20261118 03:02:38.825647 14326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda: Bootstrap starting.
I20261118 03:02:38.828280 14326 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:38.829133 14326 log.cc:826] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:38.830860 14326 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda: No bootstrap required, opened a new log
I20261118 03:02:38.833559 14326 raft_consensus.cc:360] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } }
I20261118 03:02:38.833776 14326 raft_consensus.cc:386] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:38.833817 14326 raft_consensus.cc:748] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fe7dc91184324b76ae8e330a104eacda, State: Initialized, Role: FOLLOWER
I20261118 03:02:38.834231 14326 consensus_queue.cc:261] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } }
I20261118 03:02:38.834367 14326 raft_consensus.cc:400] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:38.834405 14326 raft_consensus.cc:499] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:38.834484 14326 raft_consensus.cc:3096] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:38.835474 14326 raft_consensus.cc:521] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } }
I20261118 03:02:38.835914 14326 leader_election.cc:304] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fe7dc91184324b76ae8e330a104eacda; no voters: 
I20261118 03:02:38.836278 14326 leader_election.cc:290] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:38.836400 14331 raft_consensus.cc:2826] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:38.836606 14331 raft_consensus.cc:705] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [term 1 LEADER]: Becoming Leader. State: Replica: fe7dc91184324b76ae8e330a104eacda, State: Running, Role: LEADER
I20261118 03:02:38.837044 14331 consensus_queue.cc:238] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } }
I20261118 03:02:38.837646 14326 sys_catalog.cc:565] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:38.838886 14333 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fe7dc91184324b76ae8e330a104eacda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } } }
I20261118 03:02:38.839030 14333 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:38.838898 14332 sys_catalog.cc:455] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [sys.catalog]: SysCatalogTable state changed. Reason: New leader fe7dc91184324b76ae8e330a104eacda. Latest consensus state: current_term: 1 leader_uuid: "fe7dc91184324b76ae8e330a104eacda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fe7dc91184324b76ae8e330a104eacda" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 38281 } } }
I20261118 03:02:38.839125 14332 sys_catalog.cc:458] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:38.839481 14340 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:38.843428 14340 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:38.850096 14340 catalog_manager.cc:1398] Generated new cluster ID: 4dbb7624972041c88ef10f8853376683
I20261118 03:02:38.850184 14340 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:38.877516 14340 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:38.878749 14340 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:38.888374 14340 catalog_manager.cc:6221] T 00000000000000000000000000000000 P fe7dc91184324b76ae8e330a104eacda: Generated new TSK 0
I20261118 03:02:38.889212 14340 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:38.894035 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--builtin_ntp_servers=127.13.90.84:38653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 03:02:38.992807 14350 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:38.992980 14350 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:38.993041 14350 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:38.996460 14350 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:38.996598 14350 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:39.000514 14350 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:38653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--never_fsync=true
--heap_profile_path=/tmp/kudu.14350
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:39.001279 14350 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:39.002000 14350 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:39.007558 14355 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.007594 14358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.007694 14356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:39.007790 14350 server_base.cc:1061] running on GCE node
I20261118 03:02:39.008137 14350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:39.008693 14350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:39.009850 14350 hybrid_clock.cc:648] HybridClock initialized: now 1794970959009836 us; error 30 us; skew 500 ppm
I20261118 03:02:39.011451 14350 webserver.cc:577] Webserver started at http://127.13.90.65:36747/ using document root <none> and password file <none>
I20261118 03:02:39.012089 14350 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:39.012145 14350 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:39.012351 14350 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:39.013674 14350 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data/instance:
uuid: "e952bb07c26e484faffebe5fd24d30ea"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.014091 14350 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance:
uuid: "e952bb07c26e484faffebe5fd24d30ea"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.017307 14350 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.002s
I20261118 03:02:39.019512 14364 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.020493 14350 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:39.020596 14350 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal
uuid: "e952bb07c26e484faffebe5fd24d30ea"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.020711 14350 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:39.040077 14350 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:39.040529 14350 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:39.040692 14350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:39.041177 14350 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:39.042104 14350 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:39.042150 14350 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.042205 14350 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:39.042233 14350 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.050680 14350 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:41949
I20261118 03:02:39.050719 14477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:41949 every 8 connection(s)
I20261118 03:02:39.051620 14350 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
I20261118 03:02:39.059082 14478 heartbeater.cc:345] Connected to a master server at 127.13.90.126:38281
I20261118 03:02:39.059278 14478 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:39.059551 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14350
I20261118 03:02:39.059643 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance
I20261118 03:02:39.059746 14478 heartbeater.cc:508] Master 127.13.90.126:38281 requested a full tablet report, sending...
I20261118 03:02:39.061324 14289 ts_manager.cc:210] Registered new tserver with Master: e952bb07c26e484faffebe5fd24d30ea (127.13.90.65:41949)
I20261118 03:02:39.061709 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--builtin_ntp_servers=127.13.90.84:38653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:39.062582 14289 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:41117
W20261118 03:02:39.160698 14481 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:39.160867 14481 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:39.160928 14481 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:39.164234 14481 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:39.164363 14481 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:39.168298 14481 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:38653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--never_fsync=true
--heap_profile_path=/tmp/kudu.14481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:39.169106 14481 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:39.169801 14481 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:39.175509 14489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.175509 14487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.175752 14486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:39.175750 14481 server_base.cc:1061] running on GCE node
I20261118 03:02:39.176179 14481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:39.176745 14481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:39.177910 14481 hybrid_clock.cc:648] HybridClock initialized: now 1794970959177887 us; error 38 us; skew 500 ppm
I20261118 03:02:39.179493 14481 webserver.cc:577] Webserver started at http://127.13.90.66:46473/ using document root <none> and password file <none>
I20261118 03:02:39.180050 14481 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:39.180097 14481 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:39.180296 14481 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:39.181586 14481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data/instance:
uuid: "742b55fce6734c4cbc56a9984da7e1b2"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.181995 14481 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance:
uuid: "742b55fce6734c4cbc56a9984da7e1b2"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.185086 14481 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 03:02:39.187215 14495 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.188127 14481 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:39.188234 14481 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal
uuid: "742b55fce6734c4cbc56a9984da7e1b2"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.188313 14481 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:39.204355 14481 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:39.204814 14481 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:39.204952 14481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:39.205417 14481 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:39.206445 14481 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:39.206504 14481 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.206557 14481 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:39.206574 14481 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.214852 14481 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:36141
I20261118 03:02:39.214900 14608 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:36141 every 8 connection(s)
I20261118 03:02:39.215809 14481 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
I20261118 03:02:39.216403 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14481
I20261118 03:02:39.216514 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance
I20261118 03:02:39.219116 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--builtin_ntp_servers=127.13.90.84:38653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:39.224277 14609 heartbeater.cc:345] Connected to a master server at 127.13.90.126:38281
I20261118 03:02:39.224527 14609 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:39.225157 14609 heartbeater.cc:508] Master 127.13.90.126:38281 requested a full tablet report, sending...
I20261118 03:02:39.226269 14289 ts_manager.cc:210] Registered new tserver with Master: 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66:36141)
I20261118 03:02:39.226812 14289 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:40593
W20261118 03:02:39.319207 14612 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:39.319379 14612 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:39.319422 14612 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:39.322779 14612 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:39.322888 14612 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:39.326752 14612 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:38653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--never_fsync=true
--heap_profile_path=/tmp/kudu.14612
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:39.327499 14612 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:39.328173 14612 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:39.333853 14620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.333864 14617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.333999 14618 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:39.334214 14612 server_base.cc:1061] running on GCE node
I20261118 03:02:39.334547 14612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:39.335062 14612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:39.336222 14612 hybrid_clock.cc:648] HybridClock initialized: now 1794970959336207 us; error 28 us; skew 500 ppm
I20261118 03:02:39.337761 14612 webserver.cc:577] Webserver started at http://127.13.90.67:46117/ using document root <none> and password file <none>
I20261118 03:02:39.338305 14612 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:39.338354 14612 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:39.338644 14612 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:39.339956 14612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data/instance:
uuid: "f28146a4ba7f40ccbd4f878f19c68d41"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.340378 14612 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance:
uuid: "f28146a4ba7f40ccbd4f878f19c68d41"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.343540 14612 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:39.345885 14626 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.346854 14612 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:39.346954 14612 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal
uuid: "f28146a4ba7f40ccbd4f878f19c68d41"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.347034 14612 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:39.362120 14612 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:39.362551 14612 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:39.362680 14612 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:39.363139 14612 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:39.364037 14612 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:39.364080 14612 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.364135 14612 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:39.364166 14612 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.372380 14612 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:42679
I20261118 03:02:39.372411 14739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:42679 every 8 connection(s)
I20261118 03:02:39.373387 14612 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
I20261118 03:02:39.374513 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14612
I20261118 03:02:39.374598 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance
I20261118 03:02:39.376804 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:0
--local_ip_for_outbound_sockets=127.13.90.68
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--builtin_ntp_servers=127.13.90.84:38653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:39.381065 14740 heartbeater.cc:345] Connected to a master server at 127.13.90.126:38281
I20261118 03:02:39.381261 14740 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:39.381688 14740 heartbeater.cc:508] Master 127.13.90.126:38281 requested a full tablet report, sending...
I20261118 03:02:39.382736 14289 ts_manager.cc:210] Registered new tserver with Master: f28146a4ba7f40ccbd4f878f19c68d41 (127.13.90.67:42679)
I20261118 03:02:39.383275 14289 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:50003
W20261118 03:02:39.476109 14743 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:39.476269 14743 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:39.476310 14743 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:39.479681 14743 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:39.479789 14743 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:39.483659 14743 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:38653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:38281
--never_fsync=true
--heap_profile_path=/tmp/kudu.14743
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:39.484402 14743 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:39.485107 14743 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:39.490722 14749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:39.490695 14751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:39.490769 14743 server_base.cc:1061] running on GCE node
W20261118 03:02:39.490708 14748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:39.491190 14743 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:39.491689 14743 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:39.492823 14743 hybrid_clock.cc:648] HybridClock initialized: now 1794970959492796 us; error 40 us; skew 500 ppm
I20261118 03:02:39.494319 14743 webserver.cc:577] Webserver started at http://127.13.90.68:44401/ using document root <none> and password file <none>
I20261118 03:02:39.494854 14743 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:39.494904 14743 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:39.495110 14743 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:39.496330 14743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data/instance:
uuid: "24fb80086d984b71b09491d3b71308c0"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.496775 14743 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal/instance:
uuid: "24fb80086d984b71b09491d3b71308c0"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.499742 14743 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20261118 03:02:39.502012 14757 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.502902 14743 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:39.503010 14743 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal
uuid: "24fb80086d984b71b09491d3b71308c0"
format_stamp: "Formatted at 2026-11-18 03:02:39 on dist-test-slave-m226"
I20261118 03:02:39.503100 14743 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:39.521492 14743 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:39.521984 14743 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:39.522136 14743 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:39.522646 14743 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:39.523623 14743 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:39.523669 14743 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.523728 14743 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:39.523752 14743 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:39.532066 14743 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:45913
I20261118 03:02:39.532112 14870 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:45913 every 8 connection(s)
I20261118 03:02:39.533084 14743 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
I20261118 03:02:39.540268 14871 heartbeater.cc:345] Connected to a master server at 127.13.90.126:38281
I20261118 03:02:39.540477 14871 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:39.540967 14871 heartbeater.cc:508] Master 127.13.90.126:38281 requested a full tablet report, sending...
I20261118 03:02:39.541972 14289 ts_manager.cc:210] Registered new tserver with Master: 24fb80086d984b71b09491d3b71308c0 (127.13.90.68:45913)
I20261118 03:02:39.542075 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14743
I20261118 03:02:39.542177 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestNonVoterPromotion.1794970948883749-13673-0/minicluster-data/ts-3/wal/instance
I20261118 03:02:39.542536 14289 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:42269
I20261118 03:02:39.544332 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:39.559275 14289 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40350:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261118 03:02:39.575327 14412 tablet_service.cc:1500] Processing CreateTablet for tablet 492867f560f44e25ac0ecea60c0088a9 (DEFAULT_TABLE table=test-workload [id=f63a1b78b27744c2bf35ab8757d83f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:39.575387 14805 tablet_service.cc:1500] Processing CreateTablet for tablet 492867f560f44e25ac0ecea60c0088a9 (DEFAULT_TABLE table=test-workload [id=f63a1b78b27744c2bf35ab8757d83f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:39.575333 14674 tablet_service.cc:1500] Processing CreateTablet for tablet 492867f560f44e25ac0ecea60c0088a9 (DEFAULT_TABLE table=test-workload [id=f63a1b78b27744c2bf35ab8757d83f75]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:39.576186 14412 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492867f560f44e25ac0ecea60c0088a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:39.576215 14805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492867f560f44e25ac0ecea60c0088a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:39.576213 14674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492867f560f44e25ac0ecea60c0088a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:39.581362 14893 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Bootstrap starting.
I20261118 03:02:39.582371 14895 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Bootstrap starting.
I20261118 03:02:39.582371 14894 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: Bootstrap starting.
I20261118 03:02:39.583886 14893 tablet_bootstrap.cc:654] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:39.584597 14893 log.cc:826] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:39.584610 14895 tablet_bootstrap.cc:654] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:39.584610 14894 tablet_bootstrap.cc:654] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:39.585487 14895 log.cc:826] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:39.585487 14894 log.cc:826] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:39.585906 14893 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: No bootstrap required, opened a new log
I20261118 03:02:39.586110 14893 ts_tablet_manager.cc:1449] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20261118 03:02:39.586753 14894 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: No bootstrap required, opened a new log
I20261118 03:02:39.586925 14894 ts_tablet_manager.cc:1449] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20261118 03:02:39.587725 14895 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: No bootstrap required, opened a new log
I20261118 03:02:39.587914 14895 ts_tablet_manager.cc:1449] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20261118 03:02:39.588928 14893 raft_consensus.cc:360] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.589139 14893 raft_consensus.cc:386] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:39.589202 14893 raft_consensus.cc:748] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e952bb07c26e484faffebe5fd24d30ea, State: Initialized, Role: FOLLOWER
I20261118 03:02:39.589563 14893 consensus_queue.cc:261] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.590085 14894 raft_consensus.cc:360] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.590240 14893 ts_tablet_manager.cc:1480] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:39.590281 14894 raft_consensus.cc:386] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:39.590333 14894 raft_consensus.cc:748] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24fb80086d984b71b09491d3b71308c0, State: Initialized, Role: FOLLOWER
I20261118 03:02:39.590576 14478 heartbeater.cc:500] Master 127.13.90.126:38281 was elected leader, sending a full tablet report...
I20261118 03:02:39.590750 14894 consensus_queue.cc:261] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.590852 14895 raft_consensus.cc:360] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.591014 14895 raft_consensus.cc:386] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:39.591061 14895 raft_consensus.cc:748] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f28146a4ba7f40ccbd4f878f19c68d41, State: Initialized, Role: FOLLOWER
I20261118 03:02:39.591367 14871 heartbeater.cc:500] Master 127.13.90.126:38281 was elected leader, sending a full tablet report...
I20261118 03:02:39.591493 14895 consensus_queue.cc:261] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.591591 14894 ts_tablet_manager.cc:1480] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:39.592170 14895 ts_tablet_manager.cc:1480] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:39.592486 14740 heartbeater.cc:500] Master 127.13.90.126:38281 was elected leader, sending a full tablet report...
W20261118 03:02:39.624117 14741 tablet.cc:2441] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:39.765082 14899 raft_consensus.cc:499] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:39.765260 14899 raft_consensus.cc:521] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.766440 14899 leader_election.cc:290] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f28146a4ba7f40ccbd4f878f19c68d41 (127.13.90.67:42679), 24fb80086d984b71b09491d3b71308c0 (127.13.90.68:45913)
I20261118 03:02:39.770496 14694 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "492867f560f44e25ac0ecea60c0088a9" candidate_uuid: "e952bb07c26e484faffebe5fd24d30ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" is_pre_election: true
I20261118 03:02:39.770712 14825 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "492867f560f44e25ac0ecea60c0088a9" candidate_uuid: "e952bb07c26e484faffebe5fd24d30ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24fb80086d984b71b09491d3b71308c0" is_pre_election: true
I20261118 03:02:39.770748 14694 raft_consensus.cc:2490] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e952bb07c26e484faffebe5fd24d30ea in term 0.
I20261118 03:02:39.770936 14825 raft_consensus.cc:2490] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e952bb07c26e484faffebe5fd24d30ea in term 0.
I20261118 03:02:39.771193 14367 leader_election.cc:304] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e952bb07c26e484faffebe5fd24d30ea, f28146a4ba7f40ccbd4f878f19c68d41; no voters: 
I20261118 03:02:39.771430 14899 raft_consensus.cc:2826] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 03:02:39.771493 14899 raft_consensus.cc:499] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:39.771523 14899 raft_consensus.cc:3096] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:39.772346 14899 raft_consensus.cc:521] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.772709 14899 leader_election.cc:290] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [CANDIDATE]: Term 1 election: Requested vote from peers f28146a4ba7f40ccbd4f878f19c68d41 (127.13.90.67:42679), 24fb80086d984b71b09491d3b71308c0 (127.13.90.68:45913)
I20261118 03:02:39.772941 14694 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "492867f560f44e25ac0ecea60c0088a9" candidate_uuid: "e952bb07c26e484faffebe5fd24d30ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28146a4ba7f40ccbd4f878f19c68d41"
I20261118 03:02:39.773044 14694 raft_consensus.cc:3096] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:39.773029 14825 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "492867f560f44e25ac0ecea60c0088a9" candidate_uuid: "e952bb07c26e484faffebe5fd24d30ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24fb80086d984b71b09491d3b71308c0"
I20261118 03:02:39.773128 14825 raft_consensus.cc:3096] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:39.773834 14694 raft_consensus.cc:2490] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e952bb07c26e484faffebe5fd24d30ea in term 1.
I20261118 03:02:39.773900 14825 raft_consensus.cc:2490] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e952bb07c26e484faffebe5fd24d30ea in term 1.
I20261118 03:02:39.774072 14367 leader_election.cc:304] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e952bb07c26e484faffebe5fd24d30ea, f28146a4ba7f40ccbd4f878f19c68d41; no voters: 
I20261118 03:02:39.774221 14899 raft_consensus.cc:2826] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:39.774422 14899 raft_consensus.cc:705] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 1 LEADER]: Becoming Leader. State: Replica: e952bb07c26e484faffebe5fd24d30ea, State: Running, Role: LEADER
I20261118 03:02:39.774739 14899 consensus_queue.cc:238] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } }
I20261118 03:02:39.777865 14904 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:39.778016 14899 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:39.777964 14288 catalog_manager.cc:5840] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea reported cstate change: term changed from 0 to 1, leader changed from <none> to e952bb07c26e484faffebe5fd24d30ea (127.13.90.65). New cstate: current_term: 1 leader_uuid: "e952bb07c26e484faffebe5fd24d30ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } health_report { overall_health: UNKNOWN } } }
I20261118 03:02:39.819932 14432 consensus_queue.cc:238] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } }
I20261118 03:02:39.821995 14694 raft_consensus.cc:1285] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 1 FOLLOWER]: Refusing update from remote peer e952bb07c26e484faffebe5fd24d30ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261118 03:02:39.821997 14825 raft_consensus.cc:1285] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 1 FOLLOWER]: Refusing update from remote peer e952bb07c26e484faffebe5fd24d30ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20261118 03:02:39.822522 14899 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 03:02:39.822856 14899 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 03:02:39.824389 14899 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } } }
I20261118 03:02:39.824842 14694 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } } }
I20261118 03:02:39.825382 14825 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } } }
I20261118 03:02:39.828378 14290 catalog_manager.cc:5840] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 reported cstate change: config changed from index -1 to 2, NON_VOTER 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) added. New cstate: current_term: 1 leader_uuid: "e952bb07c26e484faffebe5fd24d30ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } } }
W20261118 03:02:39.832880 14365 consensus_peers.cc:597] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea -> Peer 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66:36141): Couldn't send request to peer 742b55fce6734c4cbc56a9984da7e1b2. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 492867f560f44e25ac0ecea60c0088a9. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:40.229061 14609 heartbeater.cc:500] Master 127.13.90.126:38281 was elected leader, sending a full tablet report...
I20261118 03:02:40.322263 14914 ts_tablet_manager.cc:979] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Initiating tablet copy from peer e952bb07c26e484faffebe5fd24d30ea (127.13.90.65:41949)
I20261118 03:02:40.322811 14914 tablet_copy_client.cc:323] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: tablet copy: Beginning tablet copy session from remote peer at address 127.13.90.65:41949
I20261118 03:02:40.326447 14452 tablet_copy_service.cc:140] P e952bb07c26e484faffebe5fd24d30ea: Received BeginTabletCopySession request for tablet 492867f560f44e25ac0ecea60c0088a9 from peer 742b55fce6734c4cbc56a9984da7e1b2 ({username='slave'} at 127.13.90.66:48023)
I20261118 03:02:40.326618 14452 tablet_copy_service.cc:161] P e952bb07c26e484faffebe5fd24d30ea: Beginning new tablet copy session on tablet 492867f560f44e25ac0ecea60c0088a9 from peer 742b55fce6734c4cbc56a9984da7e1b2 at {username='slave'} at 127.13.90.66:48023: session id = 742b55fce6734c4cbc56a9984da7e1b2-492867f560f44e25ac0ecea60c0088a9
I20261118 03:02:40.327900 14452 tablet_copy_source_session.cc:215] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: Tablet Copy: opened 0 blocks and 1 log segments
I20261118 03:02:40.331516 14914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 492867f560f44e25ac0ecea60c0088a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:40.336098 14914 tablet_copy_client.cc:806] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: tablet copy: Starting download of 0 data blocks...
I20261118 03:02:40.336287 14914 tablet_copy_client.cc:670] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: tablet copy: Starting download of 1 WAL segments...
I20261118 03:02:40.337972 14914 tablet_copy_client.cc:538] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 03:02:40.339455 14914 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Bootstrap starting.
I20261118 03:02:40.343643 14914 log.cc:826] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:40.345691 14914 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 03:02:40.345923 14914 tablet_bootstrap.cc:492] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Bootstrap complete.
I20261118 03:02:40.346181 14914 ts_tablet_manager.cc:1449] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Time spent bootstrapping tablet: real 0.007s	user 0.007s	sys 0.000s
I20261118 03:02:40.348426 14914 raft_consensus.cc:360] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } }
I20261118 03:02:40.348599 14914 raft_consensus.cc:748] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 742b55fce6734c4cbc56a9984da7e1b2, State: Initialized, Role: LEARNER
I20261118 03:02:40.348935 14914 consensus_queue.cc:261] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: true } }
I20261118 03:02:40.349643 14914 ts_tablet_manager.cc:1480] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
I20261118 03:02:40.350314 14452 tablet_copy_service.cc:342] P e952bb07c26e484faffebe5fd24d30ea: Request end of tablet copy session 742b55fce6734c4cbc56a9984da7e1b2-492867f560f44e25ac0ecea60c0088a9 received from {username='slave'} at 127.13.90.66:48023
I20261118 03:02:40.350400 14452 tablet_copy_service.cc:434] P e952bb07c26e484faffebe5fd24d30ea: ending tablet copy session 742b55fce6734c4cbc56a9984da7e1b2-492867f560f44e25ac0ecea60c0088a9 on tablet 492867f560f44e25ac0ecea60c0088a9 with peer 742b55fce6734c4cbc56a9984da7e1b2
I20261118 03:02:40.765522 14563 raft_consensus.cc:1227] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20261118 03:02:41.156004 14921 raft_consensus.cc:1074] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea: attempting to promote NON_VOTER 742b55fce6734c4cbc56a9984da7e1b2 to VOTER
I20261118 03:02:41.156466 14921 consensus_queue.cc:238] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } }
I20261118 03:02:41.157862 14825 raft_consensus.cc:1285] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 1 FOLLOWER]: Refusing update from remote peer e952bb07c26e484faffebe5fd24d30ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 03:02:41.157897 14694 raft_consensus.cc:1285] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 1 FOLLOWER]: Refusing update from remote peer e952bb07c26e484faffebe5fd24d30ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 03:02:41.157892 14563 raft_consensus.cc:1285] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [term 1 LEARNER]: Refusing update from remote peer e952bb07c26e484faffebe5fd24d30ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20261118 03:02:41.158257 14920 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 03:02:41.158433 14921 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 03:02:41.158601 14923 consensus_queue.cc:1049] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20261118 03:02:41.160948 14923 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } } }
I20261118 03:02:41.161398 14825 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P 24fb80086d984b71b09491d3b71308c0 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } } }
I20261118 03:02:41.161679 14563 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P 742b55fce6734c4cbc56a9984da7e1b2 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } } }
I20261118 03:02:41.162559 14694 raft_consensus.cc:2983] T 492867f560f44e25ac0ecea60c0088a9 P f28146a4ba7f40ccbd4f878f19c68d41 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } } }
I20261118 03:02:41.164335 14289 catalog_manager.cc:5840] T 492867f560f44e25ac0ecea60c0088a9 P e952bb07c26e484faffebe5fd24d30ea reported cstate change: config changed from index 2 to 3, 742b55fce6734c4cbc56a9984da7e1b2 (127.13.90.66) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "e952bb07c26e484faffebe5fd24d30ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "e952bb07c26e484faffebe5fd24d30ea" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 41949 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f28146a4ba7f40ccbd4f878f19c68d41" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 42679 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24fb80086d984b71b09491d3b71308c0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 45913 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "742b55fce6734c4cbc56a9984da7e1b2" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 36141 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20261118 03:02:41.256055 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14350
I20261118 03:02:41.262145 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14481
I20261118 03:02:41.267477 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14612
I20261118 03:02:41.272207 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14743
I20261118 03:02:41.276742 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14259
2026-11-18T03:02:41Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestNonVoterPromotion (2654 ms)
[ RUN      ] RaftConfigChangeITest.TestBulkChangeConfig
2026-11-18T03:02:41Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:41Z Disabled control of system clock
I20261118 03:02:41.303891 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:46869
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:40579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:46869
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 03:02:41.401221 14936 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:41.401367 14936 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:41.401402 14936 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:41.404745 14936 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:41.404794 14936 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:41.404814 14936 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:41.404835 14936 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:41.408629 14936 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:40579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal
--catalog_manager_wait_for_new_tablets_to_elect_leader=false
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:46869
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:46869
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14936
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:41.409334 14936 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:41.409974 14936 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:41.415009 14941 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.415050 14944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.415071 14942 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:41.415112 14936 server_base.cc:1061] running on GCE node
I20261118 03:02:41.415640 14936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:41.416307 14936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:41.417441 14936 hybrid_clock.cc:648] HybridClock initialized: now 1794970961417433 us; error 27 us; skew 500 ppm
I20261118 03:02:41.419041 14936 webserver.cc:577] Webserver started at http://127.13.90.126:35539/ using document root <none> and password file <none>
I20261118 03:02:41.419574 14936 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:41.419631 14936 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:41.419827 14936 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:41.421099 14936 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data/instance:
uuid: "033f54d6a3dc4b1bb51c754306344353"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.421496 14936 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal/instance:
uuid: "033f54d6a3dc4b1bb51c754306344353"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.424536 14936 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 03:02:41.426779 14950 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.427745 14936 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:41.427870 14936 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal
uuid: "033f54d6a3dc4b1bb51c754306344353"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.427950 14936 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:41.438421 14936 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:41.438850 14936 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:41.438979 14936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:41.445199 14936 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:46869
I20261118 03:02:41.445211 15002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:46869 every 8 connection(s)
I20261118 03:02:41.446168 14936 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/data/info.pb
I20261118 03:02:41.448225 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 14936
I20261118 03:02:41.448323 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/master-0/wal/instance
I20261118 03:02:41.449306 15003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:41.455480 15003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353: Bootstrap starting.
I20261118 03:02:41.457701 15003 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:41.458418 15003 log.cc:826] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:41.459743 15003 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353: No bootstrap required, opened a new log
I20261118 03:02:41.462106 15003 raft_consensus.cc:360] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } }
I20261118 03:02:41.462268 15003 raft_consensus.cc:386] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:41.462302 15003 raft_consensus.cc:748] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 033f54d6a3dc4b1bb51c754306344353, State: Initialized, Role: FOLLOWER
I20261118 03:02:41.462669 15003 consensus_queue.cc:261] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } }
I20261118 03:02:41.462780 15003 raft_consensus.cc:400] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:41.462832 15003 raft_consensus.cc:499] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:41.462911 15003 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:41.463604 15003 raft_consensus.cc:521] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } }
I20261118 03:02:41.463969 15003 leader_election.cc:304] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 033f54d6a3dc4b1bb51c754306344353; no voters: 
I20261118 03:02:41.464231 15003 leader_election.cc:290] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:41.464335 15008 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:41.464592 15008 raft_consensus.cc:705] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [term 1 LEADER]: Becoming Leader. State: Replica: 033f54d6a3dc4b1bb51c754306344353, State: Running, Role: LEADER
I20261118 03:02:41.464921 15008 consensus_queue.cc:238] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } }
I20261118 03:02:41.465250 15003 sys_catalog.cc:565] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:41.466327 15010 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 033f54d6a3dc4b1bb51c754306344353. Latest consensus state: current_term: 1 leader_uuid: "033f54d6a3dc4b1bb51c754306344353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } } }
I20261118 03:02:41.466387 15009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "033f54d6a3dc4b1bb51c754306344353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "033f54d6a3dc4b1bb51c754306344353" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 46869 } } }
I20261118 03:02:41.466460 15010 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:41.466471 15009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353 [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:41.466871 15017 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:41.470227 15017 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:41.475775 15017 catalog_manager.cc:1398] Generated new cluster ID: c026addf05c74d5b8b9b6f53945cfa4e
I20261118 03:02:41.475835 15017 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:41.506804 15017 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:41.507633 15017 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:41.513798 15017 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 033f54d6a3dc4b1bb51c754306344353: Generated new TSK 0
I20261118 03:02:41.514437 15017 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:41.523008 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--builtin_ntp_servers=127.13.90.84:40579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
W20261118 03:02:41.622329 15027 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 03:02:41.622483 15027 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:41.622503 15027 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:41.622551 15027 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:41.625825 15027 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:41.625924 15027 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:41.629776 15027 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:40579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--never_fsync=true
--heap_profile_path=/tmp/kudu.15027
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:41.630527 15027 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:41.631201 15027 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:41.636760 15035 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.636780 15033 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.636934 15032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:41.637171 15027 server_base.cc:1061] running on GCE node
I20261118 03:02:41.637528 15027 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:41.638055 15027 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:41.639214 15027 hybrid_clock.cc:648] HybridClock initialized: now 1794970961639191 us; error 48 us; skew 500 ppm
I20261118 03:02:41.640719 15027 webserver.cc:577] Webserver started at http://127.13.90.65:33307/ using document root <none> and password file <none>
I20261118 03:02:41.641252 15027 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:41.641299 15027 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:41.641490 15027 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:41.642705 15027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data/instance:
uuid: "5d86ed0f73e34c26b41fbdb0460920a7"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.643114 15027 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance:
uuid: "5d86ed0f73e34c26b41fbdb0460920a7"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.646153 15027 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:41.648260 15041 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.649271 15027 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:41.649369 15027 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal
uuid: "5d86ed0f73e34c26b41fbdb0460920a7"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.649453 15027 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:41.668392 15027 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:41.668898 15027 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:41.669045 15027 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:41.669519 15027 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:41.670439 15027 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:41.670483 15027 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.670526 15027 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:41.670553 15027 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.678634 15027 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:34955
I20261118 03:02:41.678665 15154 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:34955 every 8 connection(s)
I20261118 03:02:41.679589 15027 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/data/info.pb
I20261118 03:02:41.687264 15155 heartbeater.cc:345] Connected to a master server at 127.13.90.126:46869
I20261118 03:02:41.687537 15155 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:41.687996 15155 heartbeater.cc:508] Master 127.13.90.126:46869 requested a full tablet report, sending...
I20261118 03:02:41.688525 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15027
I20261118 03:02:41.688635 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-0/wal/instance
I20261118 03:02:41.689643 14967 ts_manager.cc:210] Registered new tserver with Master: 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955)
I20261118 03:02:41.690950 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--builtin_ntp_servers=127.13.90.84:40579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:41.691238 14967 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:53611
W20261118 03:02:41.789130 15158 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 03:02:41.789292 15158 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:41.789314 15158 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:41.789350 15158 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:41.792583 15158 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:41.792701 15158 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:41.796372 15158 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:40579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--never_fsync=true
--heap_profile_path=/tmp/kudu.15158
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:41.797201 15158 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:41.797958 15158 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:41.803469 15164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.803642 15166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.803661 15163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:41.803885 15158 server_base.cc:1061] running on GCE node
I20261118 03:02:41.804209 15158 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:41.804736 15158 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:41.805902 15158 hybrid_clock.cc:648] HybridClock initialized: now 1794970961805889 us; error 28 us; skew 500 ppm
I20261118 03:02:41.807469 15158 webserver.cc:577] Webserver started at http://127.13.90.66:39455/ using document root <none> and password file <none>
I20261118 03:02:41.808053 15158 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:41.808101 15158 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:41.808307 15158 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:41.809605 15158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data/instance:
uuid: "9152de1af690431498412a3dffe6f652"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.810020 15158 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance:
uuid: "9152de1af690431498412a3dffe6f652"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.813373 15158 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20261118 03:02:41.816869 15172 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.818164 15158 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20261118 03:02:41.818274 15158 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal
uuid: "9152de1af690431498412a3dffe6f652"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.818377 15158 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:41.838174 15158 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:41.838619 15158 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:41.838732 15158 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:41.839170 15158 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:41.840070 15158 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:41.840112 15158 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.840153 15158 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:41.840173 15158 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.848562 15158 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:33603
I20261118 03:02:41.848613 15285 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:33603 every 8 connection(s)
I20261118 03:02:41.849535 15158 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/data/info.pb
I20261118 03:02:41.856300 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15158
I20261118 03:02:41.856401 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-1/wal/instance
I20261118 03:02:41.856942 15286 heartbeater.cc:345] Connected to a master server at 127.13.90.126:46869
I20261118 03:02:41.857165 15286 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:41.857631 15286 heartbeater.cc:508] Master 127.13.90.126:46869 requested a full tablet report, sending...
I20261118 03:02:41.858438 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--builtin_ntp_servers=127.13.90.84:40579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:41.858664 14967 ts_manager.cc:210] Registered new tserver with Master: 9152de1af690431498412a3dffe6f652 (127.13.90.66:33603)
I20261118 03:02:41.859196 14967 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:37545
W20261118 03:02:41.955447 15289 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 03:02:41.955600 15289 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:41.955622 15289 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:41.955684 15289 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:41.959203 15289 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:41.959306 15289 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:41.963330 15289 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:40579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--never_fsync=true
--heap_profile_path=/tmp/kudu.15289
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:41.964090 15289 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:41.964814 15289 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:41.970345 15297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:41.970415 15289 server_base.cc:1061] running on GCE node
W20261118 03:02:41.970492 15295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:41.970477 15294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:41.970916 15289 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:41.971457 15289 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:41.972613 15289 hybrid_clock.cc:648] HybridClock initialized: now 1794970961972599 us; error 23 us; skew 500 ppm
I20261118 03:02:41.974131 15289 webserver.cc:577] Webserver started at http://127.13.90.67:45625/ using document root <none> and password file <none>
I20261118 03:02:41.974684 15289 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:41.974735 15289 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:41.974931 15289 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:41.976181 15289 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data/instance:
uuid: "f5c116d8bad947feb9d0e7721bfac662"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.976601 15289 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance:
uuid: "f5c116d8bad947feb9d0e7721bfac662"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.979694 15289 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20261118 03:02:41.981835 15303 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:41.982741 15289 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:41.982864 15289 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal
uuid: "f5c116d8bad947feb9d0e7721bfac662"
format_stamp: "Formatted at 2026-11-18 03:02:41 on dist-test-slave-m226"
I20261118 03:02:41.982954 15289 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:42.026769 15289 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:42.027287 15289 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:42.027428 15289 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:42.027940 15289 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:42.028985 15289 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:42.029032 15289 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.029091 15289 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:42.029115 15289 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.037642 15289 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:43199
I20261118 03:02:42.037703 15416 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:43199 every 8 connection(s)
I20261118 03:02:42.038628 15289 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/data/info.pb
I20261118 03:02:42.043938 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15289
I20261118 03:02:42.044047 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-2/wal/instance
I20261118 03:02:42.046047 15417 heartbeater.cc:345] Connected to a master server at 127.13.90.126:46869
I20261118 03:02:42.046217 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:0
--local_ip_for_outbound_sockets=127.13.90.68
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--builtin_ntp_servers=127.13.90.84:40579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--raft_prepare_replacement_before_eviction=true with env {}
I20261118 03:02:42.046262 15417 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:42.046705 15417 heartbeater.cc:508] Master 127.13.90.126:46869 requested a full tablet report, sending...
I20261118 03:02:42.047698 14967 ts_manager.cc:210] Registered new tserver with Master: f5c116d8bad947feb9d0e7721bfac662 (127.13.90.67:43199)
I20261118 03:02:42.048337 14967 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:47807
W20261118 03:02:42.145051 15420 flags.cc:432] Enabled unsafe flag: --enable_leader_failure_detection=false
W20261118 03:02:42.145208 15420 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:42.145238 15420 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:42.145290 15420 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:42.148509 15420 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:42.148631 15420 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:42.152390 15420 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:40579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:46869
--never_fsync=true
--heap_profile_path=/tmp/kudu.15420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:42.153185 15420 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:42.154016 15420 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:42.159729 15426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.159649 15428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.159651 15425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:42.159875 15420 server_base.cc:1061] running on GCE node
I20261118 03:02:42.160308 15420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:42.160916 15420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:42.162087 15420 hybrid_clock.cc:648] HybridClock initialized: now 1794970962162064 us; error 36 us; skew 500 ppm
I20261118 03:02:42.163767 15420 webserver.cc:577] Webserver started at http://127.13.90.68:39469/ using document root <none> and password file <none>
I20261118 03:02:42.164319 15420 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:42.164371 15420 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:42.164573 15420 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:42.165908 15420 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data/instance:
uuid: "7b32984f99b74bd1a8453442dd9604b0"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.166939 15420 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal/instance:
uuid: "7b32984f99b74bd1a8453442dd9604b0"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.170255 15420 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.003s
I20261118 03:02:42.172510 15434 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.173563 15420 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 03:02:42.173687 15420 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal
uuid: "7b32984f99b74bd1a8453442dd9604b0"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.173770 15420 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:42.194751 15420 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:42.195248 15420 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:42.195405 15420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:42.195883 15420 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:42.196869 15420 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:42.196915 15420 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.196971 15420 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:42.196995 15420 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.205259 15420 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:43009
I20261118 03:02:42.205295 15547 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:43009 every 8 connection(s)
I20261118 03:02:42.206277 15420 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/data/info.pb
I20261118 03:02:42.211477 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15420
I20261118 03:02:42.211587 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.RaftConfigChangeITest.TestBulkChangeConfig.1794970948883749-13673-0/minicluster-data/ts-3/wal/instance
I20261118 03:02:42.213624 15548 heartbeater.cc:345] Connected to a master server at 127.13.90.126:46869
I20261118 03:02:42.213833 15548 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:42.214295 15548 heartbeater.cc:508] Master 127.13.90.126:46869 requested a full tablet report, sending...
I20261118 03:02:42.215255 14967 ts_manager.cc:210] Registered new tserver with Master: 7b32984f99b74bd1a8453442dd9604b0 (127.13.90.68:43009)
I20261118 03:02:42.215801 14967 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:57517
I20261118 03:02:42.225747 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:42.241881 14967 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51042:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20261118 03:02:42.258723 15351 tablet_service.cc:1500] Processing CreateTablet for tablet 753c71ba54bd41cf8d82c2af8d0eac8e (DEFAULT_TABLE table=test-workload [id=95aaad01e8e34314a0911d2812f033e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:42.258785 15220 tablet_service.cc:1500] Processing CreateTablet for tablet 753c71ba54bd41cf8d82c2af8d0eac8e (DEFAULT_TABLE table=test-workload [id=95aaad01e8e34314a0911d2812f033e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:42.258785 15482 tablet_service.cc:1500] Processing CreateTablet for tablet 753c71ba54bd41cf8d82c2af8d0eac8e (DEFAULT_TABLE table=test-workload [id=95aaad01e8e34314a0911d2812f033e8]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:42.259656 15351 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753c71ba54bd41cf8d82c2af8d0eac8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:42.259681 15482 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753c71ba54bd41cf8d82c2af8d0eac8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:42.259682 15220 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753c71ba54bd41cf8d82c2af8d0eac8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:42.264618 15570 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Bootstrap starting.
I20261118 03:02:42.265556 15571 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: Bootstrap starting.
I20261118 03:02:42.265556 15572 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: Bootstrap starting.
I20261118 03:02:42.267362 15570 tablet_bootstrap.cc:654] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:42.267812 15571 tablet_bootstrap.cc:654] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:42.267812 15572 tablet_bootstrap.cc:654] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:42.268172 15570 log.cc:826] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:42.268644 15571 log.cc:826] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:42.268644 15572 log.cc:826] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:42.269526 15570 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: No bootstrap required, opened a new log
I20261118 03:02:42.269711 15570 ts_tablet_manager.cc:1449] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Time spent bootstrapping tablet: real 0.005s	user 0.000s	sys 0.004s
I20261118 03:02:42.270033 15572 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: No bootstrap required, opened a new log
I20261118 03:02:42.270033 15571 tablet_bootstrap.cc:492] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: No bootstrap required, opened a new log
I20261118 03:02:42.270222 15571 ts_tablet_manager.cc:1449] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.001s
I20261118 03:02:42.270222 15572 ts_tablet_manager.cc:1449] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: Time spent bootstrapping tablet: real 0.005s	user 0.001s	sys 0.002s
I20261118 03:02:42.272445 15570 raft_consensus.cc:360] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.272624 15570 raft_consensus.cc:748] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5c116d8bad947feb9d0e7721bfac662, State: Initialized, Role: FOLLOWER
I20261118 03:02:42.272948 15570 consensus_queue.cc:261] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.273201 15571 raft_consensus.cc:360] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.273201 15572 raft_consensus.cc:360] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.273392 15571 raft_consensus.cc:748] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9152de1af690431498412a3dffe6f652, State: Initialized, Role: FOLLOWER
I20261118 03:02:42.273392 15572 raft_consensus.cc:748] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b32984f99b74bd1a8453442dd9604b0, State: Initialized, Role: FOLLOWER
I20261118 03:02:42.273644 15417 heartbeater.cc:500] Master 127.13.90.126:46869 was elected leader, sending a full tablet report...
I20261118 03:02:42.273701 15570 ts_tablet_manager.cc:1480] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:42.273729 15571 consensus_queue.cc:261] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.273729 15572 consensus_queue.cc:261] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.274456 15571 ts_tablet_manager.cc:1480] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.003s
I20261118 03:02:42.274463 15572 ts_tablet_manager.cc:1480] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.002s
I20261118 03:02:42.274559 15286 heartbeater.cc:500] Master 127.13.90.126:46869 was elected leader, sending a full tablet report...
I20261118 03:02:42.275475 15548 heartbeater.cc:500] Master 127.13.90.126:46869 was elected leader, sending a full tablet report...
W20261118 03:02:42.289371 15418 tablet.cc:2441] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:42.295969 15502 tablet_service.cc:2033] Received Run Leader Election RPC: tablet_id: "753c71ba54bd41cf8d82c2af8d0eac8e"
dest_uuid: "7b32984f99b74bd1a8453442dd9604b0"
 from {username='slave'} at 127.0.0.1:59284
I20261118 03:02:42.296159 15502 raft_consensus.cc:499] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20261118 03:02:42.296265 15502 raft_consensus.cc:3096] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:42.297160 15502 raft_consensus.cc:521] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.298192 15502 leader_election.cc:290] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [CANDIDATE]: Term 1 election: Requested vote from peers f5c116d8bad947feb9d0e7721bfac662 (127.13.90.67:43199), 9152de1af690431498412a3dffe6f652 (127.13.90.66:33603)
I20261118 03:02:42.302589 15371 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "753c71ba54bd41cf8d82c2af8d0eac8e" candidate_uuid: "7b32984f99b74bd1a8453442dd9604b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "f5c116d8bad947feb9d0e7721bfac662"
I20261118 03:02:42.302781 15371 raft_consensus.cc:3096] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:42.303021 15240 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "753c71ba54bd41cf8d82c2af8d0eac8e" candidate_uuid: "7b32984f99b74bd1a8453442dd9604b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "9152de1af690431498412a3dffe6f652"
I20261118 03:02:42.303200 15240 raft_consensus.cc:3096] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:42.303905 15371 raft_consensus.cc:2490] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b32984f99b74bd1a8453442dd9604b0 in term 1.
I20261118 03:02:42.304265 15240 raft_consensus.cc:2490] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b32984f99b74bd1a8453442dd9604b0 in term 1.
I20261118 03:02:42.304351 15437 leader_election.cc:304] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b32984f99b74bd1a8453442dd9604b0, f5c116d8bad947feb9d0e7721bfac662; no voters: 
I20261118 03:02:42.304754 15577 raft_consensus.cc:2826] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:42.304948 15577 raft_consensus.cc:705] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Becoming Leader. State: Replica: 7b32984f99b74bd1a8453442dd9604b0, State: Running, Role: LEADER
I20261118 03:02:42.305322 15577 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.312528 15577 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:42.317836 14964 catalog_manager.cc:5840] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b32984f99b74bd1a8453442dd9604b0 (127.13.90.68). New cstate: current_term: 1 leader_uuid: "7b32984f99b74bd1a8453442dd9604b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } health_report { overall_health: HEALTHY } } }
I20261118 03:02:42.321887 15585 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:42.371722 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 14936
I20261118 03:02:42.378391 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.378441 13673 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.380957 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.9, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.382283 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20261118 03:02:42.382458 15240 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 9. Preceding OpId from leader: term: 1 index: 10. (index mismatch)
I20261118 03:02:42.382649 15588 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20261118 03:02:42.382808 15587 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20261118 03:02:42.384128 15587 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.384517 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.386983 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.10: config changed from index -1 to 10, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
W20261118 03:02:42.387583 15286 heartbeater.cc:648] Failed to heartbeat to 127.13.90.126:46869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.90.126:46869: connect: Connection refused (error 111)
I20261118 03:02:42.388199 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.388244 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.388304 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } }
W20261118 03:02:42.388382 15436 consensus_peers.cc:597] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 -> Peer 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955): Couldn't send request to peer 5d86ed0f73e34c26b41fbdb0460920a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753c71ba54bd41cf8d82c2af8d0eac8e. This is attempt 1: this message will repeat every 5th retry.
W20261118 03:02:42.389006 15548 heartbeater.cc:648] Failed to heartbeat to 127.13.90.126:46869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.90.126:46869: connect: Connection refused (error 111)
I20261118 03:02:42.389142 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
W20261118 03:02:42.389242 15417 heartbeater.cc:648] Failed to heartbeat to 127.13.90.126:46869 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.13.90.126:46869: connect: Connection refused (error 111)
I20261118 03:02:42.390164 15240 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20261118 03:02:42.390228 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
W20261118 03:02:42.390436 15436 consensus_peers.cc:597] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 -> Peer 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955): Couldn't send request to peer 5d86ed0f73e34c26b41fbdb0460920a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753c71ba54bd41cf8d82c2af8d0eac8e. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:42.390605 15588 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20261118 03:02:42.390745 15587 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20261118 03:02:42.391984 15585 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.392279 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.392396 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 10 to 11, 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) changed from VOTER to NON_VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.394670 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.394708 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } }
I20261118 03:02:42.395356 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } }
I20261118 03:02:42.396415 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
W20261118 03:02:42.396420 15436 consensus_peers.cc:597] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 -> Peer 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955): Couldn't send request to peer 5d86ed0f73e34c26b41fbdb0460920a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753c71ba54bd41cf8d82c2af8d0eac8e. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:42.396377 15240 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 1 index: 12. (index mismatch)
I20261118 03:02:42.396750 15588 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20261118 03:02:42.396842 15577 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20261118 03:02:42.398173 15587 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } } }
I20261118 03:02:42.398526 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } } }
I20261118 03:02:42.398587 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.12: config changed from index 11 to 12. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } } }
I20261118 03:02:42.400569 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.400621 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.400705 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: NON_VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.401598 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.401633 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: NON_VOTER last_known_addr { host: "127.13.90.68" port: 43009 } attrs { promote: false replace: false } }
I20261118 03:02:42.402585 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.402621 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: true replace: false } }
I20261118 03:02:42.403646 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.403688 13673 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.403738 13673 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.404345 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }
I20261118 03:02:42.405251 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 13. (index mismatch)
I20261118 03:02:42.405529 15587 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20261118 03:02:42.406741 15577 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) evicted, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } }
I20261118 03:02:42.407150 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) evicted, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } }
I20261118 03:02:42.408794 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.408841 13673 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.408898 13673 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.409725 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.409760 13673 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.410293 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 1.13, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.411193 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 13. Preceding OpId from leader: term: 1 index: 14. (index mismatch)
W20261118 03:02:42.411317 15436 consensus_peers.cc:597] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 -> Peer 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955): Couldn't send request to peer 5d86ed0f73e34c26b41fbdb0460920a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753c71ba54bd41cf8d82c2af8d0eac8e. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:42.411497 15588 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20261118 03:02:42.412746 15587 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.413188 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.414975 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.415022 13673 raft_config_change-itest.cc:351] type: ADD_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.415639 15502 consensus_queue.cc:238] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 1.14, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.416628 15371 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 14. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
W20261118 03:02:42.416837 15436 consensus_peers.cc:597] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 -> Peer 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65:34955): Couldn't send request to peer 5d86ed0f73e34c26b41fbdb0460920a7. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 753c71ba54bd41cf8d82c2af8d0eac8e. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:42.416858 15240 raft_consensus.cc:1285] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Refusing update from remote peer 7b32984f99b74bd1a8453442dd9604b0: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 1 index: 15. (index mismatch)
I20261118 03:02:42.416941 15577 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20261118 03:02:42.417165 15587 consensus_queue.cc:1049] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.000s
I20261118 03:02:42.418483 15240 raft_consensus.cc:879] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } }.
  Pending config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }: 
  New config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
W20261118 03:02:42.418558 15240 raft_consensus.cc:1590] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 14' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: true replace: false } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: NON_VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } }.
  Pending config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }: 
  New config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.418820 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.13: config changed from index 12 to 13, NON_VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) evicted, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) evicted. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } }
I20261118 03:02:42.420737 15240 raft_consensus.cc:1491] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20261118 03:02:42.420984 15240 raft_consensus.cc:879] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }.
  Pending config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }: 
  New config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
W20261118 03:02:42.421041 15240 raft_consensus.cc:1590] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Could not prepare op 'term: 1 index: 15' and following 0 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } }.
  Pending config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }: 
  New config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.421247 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Committing config change with OpId 1.14: config changed from index 13 to 14, VOTER 5d86ed0f73e34c26b41fbdb0460920a7 (127.13.90.65) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } }
I20261118 03:02:42.422688 15240 raft_consensus.cc:1491] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 NON_PARTICIPANT]: Allowing update even though not a member of the config
I20261118 03:02:42.423393 15577 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 7b32984f99b74bd1a8453442dd9604b0 [term 1 LEADER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } } }
I20261118 03:02:42.423743 15240 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P 9152de1af690431498412a3dffe6f652 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } } }
I20261118 03:02:42.425263 15371 raft_consensus.cc:2983] T 753c71ba54bd41cf8d82c2af8d0eac8e P f5c116d8bad947feb9d0e7721bfac662 [term 1 FOLLOWER]: Committing config change with OpId 1.15: config changed from index 14 to 15, VOTER 9152de1af690431498412a3dffe6f652 (127.13.90.66) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f5c116d8bad947feb9d0e7721bfac662" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 43199 } } peers { permanent_uuid: "7b32984f99b74bd1a8453442dd9604b0" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 43009 } } peers { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } } peers { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } } }
I20261118 03:02:42.425823 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.425864 13673 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.425905 13673 raft_config_change-itest.cc:351] type: REMOVE_PEER peer { permanent_uuid: "9152de1af690431498412a3dffe6f652" member_type: UNKNOWN_MEMBER_TYPE last_known_addr { host: "127.13.90.66" port: 33603 } attrs { promote: false replace: false } }
I20261118 03:02:42.426914 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.426960 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: false } }
I20261118 03:02:42.427711 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.428459 13673 raft_config_change-itest.cc:349] submitting config change with changes:
I20261118 03:02:42.428498 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: false replace: true } }
I20261118 03:02:42.428545 13673 raft_config_change-itest.cc:351] type: MODIFY_PEER peer { permanent_uuid: "5d86ed0f73e34c26b41fbdb0460920a7" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 34955 } attrs { promote: true replace: false } }
I20261118 03:02:42.429836 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15027
I20261118 03:02:42.435140 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15158
I20261118 03:02:42.440083 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15289
I20261118 03:02:42.444902 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15420
2026-11-18T03:02:42Z chronyd exiting
[       OK ] RaftConfigChangeITest.TestBulkChangeConfig (1167 ms)
[----------] 3 tests from RaftConfigChangeITest (13571 ms total)

[----------] 3 tests from SlowTabletBootstrapTest
[ RUN      ] SlowTabletBootstrapTest.TestSlowBootstrap
I20261118 03:02:42.466320 13673 ts_itest-base.cc:115] Starting cluster with:
I20261118 03:02:42.466367 13673 ts_itest-base.cc:116] --------------
I20261118 03:02:42.466380 13673 ts_itest-base.cc:117] 4 tablet servers
I20261118 03:02:42.466406 13673 ts_itest-base.cc:118] 3 replicas per TS
I20261118 03:02:42.466420 13673 ts_itest-base.cc:119] --------------
2026-11-18T03:02:42Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:42Z Disabled control of system clock
I20261118 03:02:42.473927 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:35699
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:35699 with env {}
W20261118 03:02:42.572227 15614 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:42.572393 15614 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:42.572449 15614 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:42.575852 15614 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:42.575914 15614 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:42.575934 15614 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:42.575953 15614 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:42.579758 15614 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:35699
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:35699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.15614
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:42.580458 15614 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:42.581172 15614 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:42.585870 15619 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.585857 15620 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.585852 15622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:42.586148 15614 server_base.cc:1061] running on GCE node
I20261118 03:02:42.586522 15614 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:42.587172 15614 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:42.588322 15614 hybrid_clock.cc:648] HybridClock initialized: now 1794970962588302 us; error 32 us; skew 500 ppm
I20261118 03:02:42.589793 15614 webserver.cc:577] Webserver started at http://127.13.90.126:34419/ using document root <none> and password file <none>
I20261118 03:02:42.590323 15614 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:42.590368 15614 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:42.590561 15614 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:42.591823 15614 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "8b38ce5a2310417590d045021c3c449e"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.592214 15614 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "8b38ce5a2310417590d045021c3c449e"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.595280 15614 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:42.597473 15628 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.598397 15614 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:42.598512 15614 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
uuid: "8b38ce5a2310417590d045021c3c449e"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.598627 15614 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:42.617725 15614 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:42.618232 15614 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:42.618379 15614 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:42.625070 15614 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:35699
I20261118 03:02:42.625098 15680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:35699 every 8 connection(s)
I20261118 03:02:42.626068 15614 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 03:02:42.628261 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15614
I20261118 03:02:42.628372 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 03:02:42.629403 15681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:42.634936 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e: Bootstrap starting.
I20261118 03:02:42.637148 15681 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:42.637850 15681 log.cc:826] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:42.639252 15681 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e: No bootstrap required, opened a new log
I20261118 03:02:42.641569 15681 raft_consensus.cc:360] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } }
I20261118 03:02:42.641729 15681 raft_consensus.cc:386] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:42.641764 15681 raft_consensus.cc:748] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b38ce5a2310417590d045021c3c449e, State: Initialized, Role: FOLLOWER
I20261118 03:02:42.642127 15681 consensus_queue.cc:261] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } }
I20261118 03:02:42.642242 15681 raft_consensus.cc:400] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:42.642297 15681 raft_consensus.cc:499] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:42.642364 15681 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:42.643059 15681 raft_consensus.cc:521] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } }
I20261118 03:02:42.643373 15681 leader_election.cc:304] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b38ce5a2310417590d045021c3c449e; no voters: 
I20261118 03:02:42.643646 15681 leader_election.cc:290] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:42.643728 15686 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:42.643927 15686 raft_consensus.cc:705] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [term 1 LEADER]: Becoming Leader. State: Replica: 8b38ce5a2310417590d045021c3c449e, State: Running, Role: LEADER
I20261118 03:02:42.644236 15686 consensus_queue.cc:238] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } }
I20261118 03:02:42.644626 15681 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:42.645680 15688 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b38ce5a2310417590d045021c3c449e. Latest consensus state: current_term: 1 leader_uuid: "8b38ce5a2310417590d045021c3c449e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } } }
I20261118 03:02:42.645789 15688 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:42.646166 15695 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:42.646646 15687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b38ce5a2310417590d045021c3c449e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b38ce5a2310417590d045021c3c449e" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 35699 } } }
I20261118 03:02:42.646733 15687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:42.649017 15695 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:42.653823 15695 catalog_manager.cc:1398] Generated new cluster ID: b84aed7ab57646dd8913c13d862292c2
I20261118 03:02:42.653885 15695 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:42.676506 15695 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:42.677686 15695 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:42.687252 15695 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 8b38ce5a2310417590d045021c3c449e: Generated new TSK 0
I20261118 03:02:42.688007 15695 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:42.698220 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:42.796768 15705 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:42.796968 15705 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:42.797003 15705 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:42.797068 15705 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:42.800384 15705 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:42.800434 15705 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:42.800484 15705 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:42.800577 15705 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:42.800617 15705 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:42.804610 15705 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--never_fsync=true
--heap_profile_path=/tmp/kudu.15705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:42.805346 15705 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:42.806015 15705 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:42.811620 15711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:42.811699 15705 server_base.cc:1061] running on GCE node
W20261118 03:02:42.811839 15713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.811865 15710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:42.812320 15705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:42.812908 15705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:42.814062 15705 hybrid_clock.cc:648] HybridClock initialized: now 1794970962814051 us; error 28 us; skew 500 ppm
I20261118 03:02:42.815683 15705 webserver.cc:577] Webserver started at http://127.13.90.65:42255/ using document root <none> and password file <none>
I20261118 03:02:42.816250 15705 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:42.816300 15705 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:42.816511 15705 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:42.817845 15705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "6944a80e452d4c78812ff423aca13a08"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.818274 15705 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "6944a80e452d4c78812ff423aca13a08"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.821605 15705 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20261118 03:02:42.824110 15719 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.825294 15705 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:42.825412 15705 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "6944a80e452d4c78812ff423aca13a08"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.825500 15705 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:42.839635 15705 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:42.840039 15705 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:42.840175 15705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:42.840624 15705 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:42.841584 15705 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:42.841630 15705 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.841686 15705 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:42.841715 15705 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.850101 15705 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:44933
I20261118 03:02:42.850142 15832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:44933 every 8 connection(s)
I20261118 03:02:42.851044 15705 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 03:02:42.853332 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15705
I20261118 03:02:42.853451 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 03:02:42.855762 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:42.859153 15833 heartbeater.cc:345] Connected to a master server at 127.13.90.126:35699
I20261118 03:02:42.859380 15833 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:42.859901 15833 heartbeater.cc:508] Master 127.13.90.126:35699 requested a full tablet report, sending...
I20261118 03:02:42.861651 15645 ts_manager.cc:210] Registered new tserver with Master: 6944a80e452d4c78812ff423aca13a08 (127.13.90.65:44933)
I20261118 03:02:42.863399 15645 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:48027
W20261118 03:02:42.955508 15836 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:42.955699 15836 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:42.955719 15836 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:42.955761 15836 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:42.959123 15836 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:42.959174 15836 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:42.959208 15836 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:42.959266 15836 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:42.959295 15836 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:42.963191 15836 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--never_fsync=true
--heap_profile_path=/tmp/kudu.15836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:42.963900 15836 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:42.964552 15836 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:42.970240 15844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.970248 15842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:42.970342 15841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:42.970511 15836 server_base.cc:1061] running on GCE node
I20261118 03:02:42.970880 15836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:42.971398 15836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:42.972533 15836 hybrid_clock.cc:648] HybridClock initialized: now 1794970962972519 us; error 30 us; skew 500 ppm
I20261118 03:02:42.974133 15836 webserver.cc:577] Webserver started at http://127.13.90.66:42227/ using document root <none> and password file <none>
I20261118 03:02:42.974668 15836 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:42.974713 15836 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:42.974903 15836 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:42.976169 15836 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "9997f97f332b40dca7367f4405bafa0c"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.976567 15836 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "9997f97f332b40dca7367f4405bafa0c"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.979821 15836 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20261118 03:02:42.982128 15850 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:42.983108 15836 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:42.983212 15836 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "9997f97f332b40dca7367f4405bafa0c"
format_stamp: "Formatted at 2026-11-18 03:02:42 on dist-test-slave-m226"
I20261118 03:02:42.983294 15836 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:42.998997 15836 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:42.999380 15836 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:42.999518 15836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:42.999961 15836 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:43.000892 15836 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:43.000939 15836 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.000995 15836 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:43.001022 15836 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.008987 15836 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:33595
I20261118 03:02:43.009024 15963 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:33595 every 8 connection(s)
I20261118 03:02:43.009917 15836 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 03:02:43.011102 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15836
I20261118 03:02:43.011236 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 03:02:43.013576 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:43.017951 15964 heartbeater.cc:345] Connected to a master server at 127.13.90.126:35699
I20261118 03:02:43.018167 15964 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:43.018612 15964 heartbeater.cc:508] Master 127.13.90.126:35699 requested a full tablet report, sending...
I20261118 03:02:43.019587 15645 ts_manager.cc:210] Registered new tserver with Master: 9997f97f332b40dca7367f4405bafa0c (127.13.90.66:33595)
I20261118 03:02:43.020113 15645 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:47987
W20261118 03:02:43.114081 15967 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:43.114285 15967 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:43.114327 15967 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:43.114389 15967 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:43.117792 15967 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:43.117847 15967 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:43.117897 15967 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:43.117987 15967 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:43.118024 15967 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:43.121917 15967 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--never_fsync=true
--heap_profile_path=/tmp/kudu.15967
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:43.122676 15967 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:43.123371 15967 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:43.128912 15972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:43.128901 15975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:43.129134 15967 server_base.cc:1061] running on GCE node
W20261118 03:02:43.129143 15973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:43.129534 15967 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:43.130055 15967 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:43.131222 15967 hybrid_clock.cc:648] HybridClock initialized: now 1794970963131206 us; error 27 us; skew 500 ppm
I20261118 03:02:43.132838 15967 webserver.cc:577] Webserver started at http://127.13.90.67:36017/ using document root <none> and password file <none>
I20261118 03:02:43.133374 15967 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:43.133422 15967 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:43.133625 15967 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:43.134857 15967 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "f2004b4afc20441ca9cf6d6277e1c46b"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.135270 15967 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "f2004b4afc20441ca9cf6d6277e1c46b"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.138397 15967 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:43.140730 15981 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.141646 15967 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:43.141749 15967 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "f2004b4afc20441ca9cf6d6277e1c46b"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.141830 15967 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:43.156977 15967 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:43.157362 15967 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:43.157488 15967 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:43.157933 15967 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:43.158841 15967 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:43.158887 15967 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.158941 15967 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:43.158967 15967 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.166950 15967 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:35893
I20261118 03:02:43.166986 16094 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:35893 every 8 connection(s)
I20261118 03:02:43.167900 15967 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 03:02:43.169098 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 15967
I20261118 03:02:43.169205 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 03:02:43.171412 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:0
--local_ip_for_outbound_sockets=127.13.90.68
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:43.175427 16095 heartbeater.cc:345] Connected to a master server at 127.13.90.126:35699
I20261118 03:02:43.175664 16095 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:43.176209 16095 heartbeater.cc:508] Master 127.13.90.126:35699 requested a full tablet report, sending...
I20261118 03:02:43.177327 15645 ts_manager.cc:210] Registered new tserver with Master: f2004b4afc20441ca9cf6d6277e1c46b (127.13.90.67:35893)
I20261118 03:02:43.178030 15645 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:38933
W20261118 03:02:43.272253 16098 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:43.272455 16098 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:43.272495 16098 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:43.272562 16098 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:43.275868 16098 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:43.275921 16098 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:43.275962 16098 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:43.276059 16098 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:43.276093 16098 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:43.279917 16098 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:35699
--never_fsync=true
--heap_profile_path=/tmp/kudu.16098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:43.280644 16098 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:43.281324 16098 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:43.286782 16104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:43.286787 16106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:43.286880 16098 server_base.cc:1061] running on GCE node
W20261118 03:02:43.287088 16103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:43.287422 16098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:43.287983 16098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:43.289134 16098 hybrid_clock.cc:648] HybridClock initialized: now 1794970963289116 us; error 32 us; skew 500 ppm
I20261118 03:02:43.290761 16098 webserver.cc:577] Webserver started at http://127.13.90.68:43063/ using document root <none> and password file <none>
I20261118 03:02:43.291344 16098 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:43.291397 16098 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:43.291601 16098 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:43.292941 16098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "4125aae8a66d492d9fec20fdbf4b2971"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.293349 16098 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "4125aae8a66d492d9fec20fdbf4b2971"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.296449 16098 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 03:02:43.298763 16112 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.299710 16098 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:43.299814 16098 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "4125aae8a66d492d9fec20fdbf4b2971"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.299892 16098 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:43.324821 16098 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:43.325268 16098 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:43.325402 16098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:43.325924 16098 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:43.326893 16098 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:43.326939 16098 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.326994 16098 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:43.327023 16098 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.334985 16098 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:34699
I20261118 03:02:43.335027 16225 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:34699 every 8 connection(s)
I20261118 03:02:43.335948 16098 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 03:02:43.336867 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16098
I20261118 03:02:43.336977 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 03:02:43.343303 16226 heartbeater.cc:345] Connected to a master server at 127.13.90.126:35699
I20261118 03:02:43.343519 16226 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:43.343968 16226 heartbeater.cc:508] Master 127.13.90.126:35699 requested a full tablet report, sending...
I20261118 03:02:43.344976 15645 ts_manager.cc:210] Registered new tserver with Master: 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699)
I20261118 03:02:43.345510 15645 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:39919
I20261118 03:02:43.350781 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:43.359056 15645 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34224:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 03:02:43.377033 15767 tablet_service.cc:1500] Processing CreateTablet for tablet de309df533d54e25b833c9d58c158f9f (DEFAULT_TABLE table=TestTable [id=11f70480601449a6a8a54e4313803ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:43.377043 16029 tablet_service.cc:1500] Processing CreateTablet for tablet de309df533d54e25b833c9d58c158f9f (DEFAULT_TABLE table=TestTable [id=11f70480601449a6a8a54e4313803ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:43.377740 16160 tablet_service.cc:1500] Processing CreateTablet for tablet de309df533d54e25b833c9d58c158f9f (DEFAULT_TABLE table=TestTable [id=11f70480601449a6a8a54e4313803ba1]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:43.378051 16029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de309df533d54e25b833c9d58c158f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:43.378051 15767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de309df533d54e25b833c9d58c158f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:43.378480 16160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de309df533d54e25b833c9d58c158f9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:43.383177 16243 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Bootstrap starting.
I20261118 03:02:43.384243 16245 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Bootstrap starting.
I20261118 03:02:43.385686 16243 tablet_bootstrap.cc:654] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:43.386462 16245 tablet_bootstrap.cc:654] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:43.386564 16243 log.cc:826] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:43.387224 16244 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Bootstrap starting.
I20261118 03:02:43.387372 16245 log.cc:826] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:43.388036 16243 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: No bootstrap required, opened a new log
I20261118 03:02:43.388232 16243 ts_tablet_manager.cc:1449] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:43.388857 16245 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: No bootstrap required, opened a new log
I20261118 03:02:43.389053 16245 ts_tablet_manager.cc:1449] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:43.389398 16244 tablet_bootstrap.cc:654] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:43.390214 16244 log.cc:826] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:43.391099 16243 raft_consensus.cc:360] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.391304 16243 raft_consensus.cc:386] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:43.391363 16243 raft_consensus.cc:748] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4125aae8a66d492d9fec20fdbf4b2971, State: Initialized, Role: FOLLOWER
I20261118 03:02:43.391605 16244 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: No bootstrap required, opened a new log
I20261118 03:02:43.391788 16244 ts_tablet_manager.cc:1449] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:43.391785 16243 consensus_queue.cc:261] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.391824 16245 raft_consensus.cc:360] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.392011 16245 raft_consensus.cc:386] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:43.392061 16245 raft_consensus.cc:748] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2004b4afc20441ca9cf6d6277e1c46b, State: Initialized, Role: FOLLOWER
I20261118 03:02:43.392503 16226 heartbeater.cc:500] Master 127.13.90.126:35699 was elected leader, sending a full tablet report...
I20261118 03:02:43.392546 16243 ts_tablet_manager.cc:1480] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:43.392493 16245 consensus_queue.cc:261] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.393217 16245 ts_tablet_manager.cc:1480] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:43.393551 16095 heartbeater.cc:500] Master 127.13.90.126:35699 was elected leader, sending a full tablet report...
I20261118 03:02:43.394513 16244 raft_consensus.cc:360] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.394690 16244 raft_consensus.cc:386] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:43.394752 16244 raft_consensus.cc:748] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6944a80e452d4c78812ff423aca13a08, State: Initialized, Role: FOLLOWER
I20261118 03:02:43.395094 16244 consensus_queue.cc:261] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.395704 15833 heartbeater.cc:500] Master 127.13.90.126:35699 was elected leader, sending a full tablet report...
I20261118 03:02:43.395818 16244 ts_tablet_manager.cc:1480] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20261118 03:02:43.436769 16227 tablet.cc:2441] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:43.452800 15834 tablet.cc:2441] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:43.469046 16096 tablet.cc:2441] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:43.595541 16249 raft_consensus.cc:499] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:43.595736 16249 raft_consensus.cc:521] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.597072 16249 leader_election.cc:290] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f2004b4afc20441ca9cf6d6277e1c46b (127.13.90.67:35893), 6944a80e452d4c78812ff423aca13a08 (127.13.90.65:44933)
I20261118 03:02:43.600862 15787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "4125aae8a66d492d9fec20fdbf4b2971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6944a80e452d4c78812ff423aca13a08" is_pre_election: true
I20261118 03:02:43.601073 16049 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "4125aae8a66d492d9fec20fdbf4b2971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" is_pre_election: true
I20261118 03:02:43.601177 15787 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4125aae8a66d492d9fec20fdbf4b2971 in term 0.
I20261118 03:02:43.601289 16049 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4125aae8a66d492d9fec20fdbf4b2971 in term 0.
I20261118 03:02:43.601663 16116 leader_election.cc:304] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4125aae8a66d492d9fec20fdbf4b2971, 6944a80e452d4c78812ff423aca13a08; no voters: 
I20261118 03:02:43.601907 16249 raft_consensus.cc:2826] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 03:02:43.601996 16249 raft_consensus.cc:499] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:43.602048 16249 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:43.602882 16249 raft_consensus.cc:521] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.603205 16249 leader_election.cc:290] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [CANDIDATE]: Term 1 election: Requested vote from peers f2004b4afc20441ca9cf6d6277e1c46b (127.13.90.67:35893), 6944a80e452d4c78812ff423aca13a08 (127.13.90.65:44933)
I20261118 03:02:43.603508 16049 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "4125aae8a66d492d9fec20fdbf4b2971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f2004b4afc20441ca9cf6d6277e1c46b"
I20261118 03:02:43.603525 15787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "4125aae8a66d492d9fec20fdbf4b2971" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6944a80e452d4c78812ff423aca13a08"
I20261118 03:02:43.603626 16049 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:43.603626 15787 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:43.604708 16049 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4125aae8a66d492d9fec20fdbf4b2971 in term 1.
I20261118 03:02:43.604995 16114 leader_election.cc:304] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4125aae8a66d492d9fec20fdbf4b2971, f2004b4afc20441ca9cf6d6277e1c46b; no voters: 
I20261118 03:02:43.605089 15787 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4125aae8a66d492d9fec20fdbf4b2971 in term 1.
I20261118 03:02:43.605177 16249 raft_consensus.cc:2826] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:43.605376 16249 raft_consensus.cc:705] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 LEADER]: Becoming Leader. State: Replica: 4125aae8a66d492d9fec20fdbf4b2971, State: Running, Role: LEADER
I20261118 03:02:43.605789 16249 consensus_queue.cc:238] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:43.609151 16249 consensus_queue.cc:1049] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:43.609301 16253 consensus_queue.cc:1049] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:43.609190 15645 catalog_manager.cc:5840] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68). New cstate: current_term: 1 leader_uuid: "4125aae8a66d492d9fec20fdbf4b2971" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } health_report { overall_health: HEALTHY } } }
I20261118 03:02:43.659578 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:43.661185 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 6944a80e452d4c78812ff423aca13a08 to finish bootstrapping
I20261118 03:02:43.666441 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver f2004b4afc20441ca9cf6d6277e1c46b to finish bootstrapping
I20261118 03:02:43.670773 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 4125aae8a66d492d9fec20fdbf4b2971 to finish bootstrapping
I20261118 03:02:43.675177 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16098
I20261118 03:02:43.681157 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:34699
--local_ip_for_outbound_sockets=127.13.90.68
--tserver_master_addrs=127.13.90.126:35699
--webserver_port=43063
--webserver_interface=127.13.90.68
--builtin_ntp_servers=127.13.90.84:39637
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000
--tablet_bootstrap_inject_latency_ms=4000 with env {}
W20261118 03:02:43.779759 16262 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:43.779951 16262 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:43.779971 16262 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:43.780009 16262 flags.cc:432] Enabled unsafe flag: --tablet_bootstrap_inject_latency_ms=4000
W20261118 03:02:43.780038 16262 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:43.783327 16262 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:43.783375 16262 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:43.783408 16262 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:43.783470 16262 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:43.783499 16262 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:43.787349 16262 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:39637
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:34699
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=43063
--tserver_master_addrs=127.13.90.126:35699
--tablet_bootstrap_inject_latency_ms=4000
--never_fsync=true
--heap_profile_path=/tmp/kudu.16262
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:43.788054 16262 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:43.788712 16262 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:43.794046 16268 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:43.794096 16267 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:43.794116 16270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:43.794292 16262 server_base.cc:1061] running on GCE node
I20261118 03:02:43.794672 16262 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:43.795145 16262 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:43.796290 16262 hybrid_clock.cc:648] HybridClock initialized: now 1794970963796264 us; error 37 us; skew 500 ppm
I20261118 03:02:43.797914 16262 webserver.cc:577] Webserver started at http://127.13.90.68:43063/ using document root <none> and password file <none>
I20261118 03:02:43.798436 16262 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:43.798496 16262 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:43.801652 16262 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 03:02:43.803606 16276 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:43.804533 16262 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:43.804638 16262 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "4125aae8a66d492d9fec20fdbf4b2971"
format_stamp: "Formatted at 2026-11-18 03:02:43 on dist-test-slave-m226"
I20261118 03:02:43.804989 16262 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:43.828338 16262 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:43.828856 16262 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:43.828994 16262 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:43.829509 16262 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:43.830698 16283 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 03:02:43.834301 16262 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 03:02:43.834357 16262 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 03:02:43.834427 16262 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 03:02:43.835952 16262 ts_tablet_manager.cc:662] Registered 1 tablets
I20261118 03:02:43.835992 16262 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
W20261118 03:02:43.836020 16283 ts_tablet_manager.cc:1428] Injecting 4000ms delay in tablet bootstrapping
I20261118 03:02:43.843921 16262 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:34699
I20261118 03:02:43.843961 16390 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:34699 every 8 connection(s)
I20261118 03:02:43.844944 16262 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 03:02:43.850936 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16262
I20261118 03:02:43.855964 16391 heartbeater.cc:345] Connected to a master server at 127.13.90.126:35699
I20261118 03:02:43.856202 16391 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:43.856714 16391 heartbeater.cc:508] Master 127.13.90.126:35699 requested a full tablet report, sending...
I20261118 03:02:43.858172 15645 ts_manager.cc:210] Re-registered known tserver with Master: 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699)
I20261118 03:02:43.858908 15645 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:46013
I20261118 03:02:44.021838 15964 heartbeater.cc:500] Master 127.13.90.126:35699 was elected leader, sending a full tablet report...
I20261118 03:02:44.860750 16391 heartbeater.cc:500] Master 127.13.90.126:35699 was elected leader, sending a full tablet report...
I20261118 03:02:45.113724 16394 raft_consensus.cc:499] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4125aae8a66d492d9fec20fdbf4b2971)
I20261118 03:02:45.113863 16394 raft_consensus.cc:521] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:45.114941 16394 leader_election.cc:290] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6944a80e452d4c78812ff423aca13a08 (127.13.90.65:44933), 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699)
I20261118 03:02:45.115218 16395 raft_consensus.cc:499] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4125aae8a66d492d9fec20fdbf4b2971)
I20261118 03:02:45.115339 16395 raft_consensus.cc:521] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:45.116477 16395 leader_election.cc:290] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f2004b4afc20441ca9cf6d6277e1c46b (127.13.90.67:35893), 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699)
I20261118 03:02:45.120307 15787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6944a80e452d4c78812ff423aca13a08" is_pre_election: true
I20261118 03:02:45.120438 15787 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f2004b4afc20441ca9cf6d6277e1c46b in term 1.
I20261118 03:02:45.120846 15985 leader_election.cc:304] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6944a80e452d4c78812ff423aca13a08, f2004b4afc20441ca9cf6d6277e1c46b; no voters: 
I20261118 03:02:45.121073 16394 raft_consensus.cc:2826] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 03:02:45.121132 16394 raft_consensus.cc:499] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4125aae8a66d492d9fec20fdbf4b2971)
I20261118 03:02:45.121176 16394 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:45.121024 16345 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4125aae8a66d492d9fec20fdbf4b2971" is_pre_election: true
I20261118 03:02:45.122196 16394 raft_consensus.cc:521] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:45.122534 16394 leader_election.cc:290] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 election: Requested vote from peers 6944a80e452d4c78812ff423aca13a08 (127.13.90.65:44933), 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699)
I20261118 03:02:45.121026 16344 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "6944a80e452d4c78812ff423aca13a08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4125aae8a66d492d9fec20fdbf4b2971" is_pre_election: true
W20261118 03:02:45.122979 15985 leader_election.cc:343] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:45.123018 15787 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6944a80e452d4c78812ff423aca13a08"
I20261118 03:02:45.123112 15787 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 1 FOLLOWER]: Advancing to term 2
W20261118 03:02:45.123250 15723 leader_election.cc:343] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:45.123481 16344 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4125aae8a66d492d9fec20fdbf4b2971"
I20261118 03:02:45.123499 16049 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "de309df533d54e25b833c9d58c158f9f" candidate_uuid: "6944a80e452d4c78812ff423aca13a08" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" is_pre_election: true
I20261118 03:02:45.123636 16049 raft_consensus.cc:2415] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6944a80e452d4c78812ff423aca13a08 in current term 2: Already voted for candidate f2004b4afc20441ca9cf6d6277e1c46b in this term.
W20261118 03:02:45.123788 15985 leader_election.cc:343] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:45.123911 15787 raft_consensus.cc:2490] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f2004b4afc20441ca9cf6d6277e1c46b in term 2.
I20261118 03:02:45.124028 15721 leader_election.cc:304] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6944a80e452d4c78812ff423aca13a08; no voters: 4125aae8a66d492d9fec20fdbf4b2971, f2004b4afc20441ca9cf6d6277e1c46b
I20261118 03:02:45.124207 16395 raft_consensus.cc:2771] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261118 03:02:45.124472 15985 leader_election.cc:304] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6944a80e452d4c78812ff423aca13a08, f2004b4afc20441ca9cf6d6277e1c46b; no voters: 4125aae8a66d492d9fec20fdbf4b2971
I20261118 03:02:45.124612 16394 raft_consensus.cc:2826] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 2 FOLLOWER]: Leader election won for term 2
I20261118 03:02:45.124818 16394 raft_consensus.cc:705] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [term 2 LEADER]: Becoming Leader. State: Replica: f2004b4afc20441ca9cf6d6277e1c46b, State: Running, Role: LEADER
I20261118 03:02:45.125137 16394 consensus_queue.cc:238] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:45.126916 15787 raft_consensus.cc:1285] T de309df533d54e25b833c9d58c158f9f P 6944a80e452d4c78812ff423aca13a08 [term 2 FOLLOWER]: Refusing update from remote peer f2004b4afc20441ca9cf6d6277e1c46b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20261118 03:02:45.127410 16394 consensus_queue.cc:1049] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20261118 03:02:45.127592 15985 consensus_peers.cc:597] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b -> Peer 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699): Couldn't send request to peer 4125aae8a66d492d9fec20fdbf4b2971. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:45.127633 15645 catalog_manager.cc:5840] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b reported cstate change: term changed from 1 to 2, leader changed from 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68) to f2004b4afc20441ca9cf6d6277e1c46b (127.13.90.67). New cstate: current_term: 2 leader_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } health_report { overall_health: UNKNOWN } } }
W20261118 03:02:47.638643 15985 consensus_peers.cc:597] T de309df533d54e25b833c9d58c158f9f P f2004b4afc20441ca9cf6d6277e1c46b -> Peer 4125aae8a66d492d9fec20fdbf4b2971 (127.13.90.68:34699): Couldn't send request to peer 4125aae8a66d492d9fec20fdbf4b2971. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20261118 03:02:47.836535 16283 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Bootstrap starting.
I20261118 03:02:47.843307 16283 log.cc:826] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:47.845865 16283 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 03:02:47.846201 16283 tablet_bootstrap.cc:492] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Bootstrap complete.
I20261118 03:02:47.846625 16283 ts_tablet_manager.cc:1449] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Time spent bootstrapping tablet: real 0.010s	user 0.008s	sys 0.000s
I20261118 03:02:47.848914 16283 raft_consensus.cc:360] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:47.849246 16283 raft_consensus.cc:748] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4125aae8a66d492d9fec20fdbf4b2971, State: Initialized, Role: FOLLOWER
I20261118 03:02:47.849601 16283 consensus_queue.cc:261] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f2004b4afc20441ca9cf6d6277e1c46b" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35893 } } peers { permanent_uuid: "6944a80e452d4c78812ff423aca13a08" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 44933 } } peers { permanent_uuid: "4125aae8a66d492d9fec20fdbf4b2971" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 34699 } }
I20261118 03:02:47.850243 16283 ts_tablet_manager.cc:1480] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:48.091547 16344 raft_consensus.cc:3096] T de309df533d54e25b833c9d58c158f9f P 4125aae8a66d492d9fec20fdbf4b2971 [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:50.863287 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15705
I20261118 03:02:50.869524 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15836
I20261118 03:02:50.874274 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15967
I20261118 03:02:50.878998 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16262
I20261118 03:02:50.883456 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 15614
2026-11-18T03:02:50Z chronyd exiting
[       OK ] SlowTabletBootstrapTest.TestSlowBootstrap (8438 ms)
[ RUN      ] SlowTabletBootstrapTest.TestFallBehind
I20261118 03:02:50.904299 13673 ts_itest-base.cc:115] Starting cluster with:
I20261118 03:02:50.904340 13673 ts_itest-base.cc:116] --------------
I20261118 03:02:50.904349 13673 ts_itest-base.cc:117] 4 tablet servers
I20261118 03:02:50.904358 13673 ts_itest-base.cc:118] 3 replicas per TS
I20261118 03:02:50.904367 13673 ts_itest-base.cc:119] --------------
2026-11-18T03:02:50Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:50Z Disabled control of system clock
I20261118 03:02:50.911489 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:45763
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:45763 with env {}
W20261118 03:02:51.008291 16431 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:51.008458 16431 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:51.008522 16431 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:51.011809 16431 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:51.011863 16431 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:51.011891 16431 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:51.011916 16431 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:51.015756 16431 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:45763
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:45763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.16431
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:51.016481 16431 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:51.017179 16431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:51.022455 16436 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.022460 16437 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.022619 16439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.022714 16431 server_base.cc:1061] running on GCE node
I20261118 03:02:51.023123 16431 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:51.023782 16431 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:51.024932 16431 hybrid_clock.cc:648] HybridClock initialized: now 1794970971024911 us; error 30 us; skew 500 ppm
I20261118 03:02:51.026368 16431 webserver.cc:577] Webserver started at http://127.13.90.126:46243/ using document root <none> and password file <none>
I20261118 03:02:51.026891 16431 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:51.026938 16431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:51.027145 16431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:51.028362 16431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "c0d13e20e59d4eb6a9469bbbb9959475"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.028788 16431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "c0d13e20e59d4eb6a9469bbbb9959475"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.031756 16431 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20261118 03:02:51.033869 16445 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.034888 16431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:51.035019 16431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
uuid: "c0d13e20e59d4eb6a9469bbbb9959475"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.035099 16431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:51.053915 16431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:51.054407 16431 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:51.054553 16431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:51.061194 16431 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:45763
I20261118 03:02:51.061206 16497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:45763 every 8 connection(s)
I20261118 03:02:51.062172 16431 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 03:02:51.065258 16498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:51.065815 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16431
I20261118 03:02:51.065943 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 03:02:51.071015 16498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475: Bootstrap starting.
I20261118 03:02:51.073390 16498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:51.074141 16498 log.cc:826] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:51.075402 16498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475: No bootstrap required, opened a new log
I20261118 03:02:51.077741 16498 raft_consensus.cc:360] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } }
I20261118 03:02:51.077905 16498 raft_consensus.cc:386] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:51.077939 16498 raft_consensus.cc:748] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0d13e20e59d4eb6a9469bbbb9959475, State: Initialized, Role: FOLLOWER
I20261118 03:02:51.078279 16498 consensus_queue.cc:261] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } }
I20261118 03:02:51.078392 16498 raft_consensus.cc:400] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:51.078433 16498 raft_consensus.cc:499] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:51.078492 16498 raft_consensus.cc:3096] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:51.079173 16498 raft_consensus.cc:521] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } }
I20261118 03:02:51.079499 16498 leader_election.cc:304] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c0d13e20e59d4eb6a9469bbbb9959475; no voters: 
I20261118 03:02:51.079739 16498 leader_election.cc:290] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:51.079838 16503 raft_consensus.cc:2826] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:51.080051 16503 raft_consensus.cc:705] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [term 1 LEADER]: Becoming Leader. State: Replica: c0d13e20e59d4eb6a9469bbbb9959475, State: Running, Role: LEADER
I20261118 03:02:51.080327 16503 consensus_queue.cc:238] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } }
I20261118 03:02:51.080725 16498 sys_catalog.cc:565] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:51.081981 16505 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c0d13e20e59d4eb6a9469bbbb9959475. Latest consensus state: current_term: 1 leader_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } } }
I20261118 03:02:51.082084 16505 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:51.082762 16504 sys_catalog.cc:455] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c0d13e20e59d4eb6a9469bbbb9959475" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 45763 } } }
I20261118 03:02:51.082844 16504 sys_catalog.cc:458] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475 [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:51.083055 16512 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:51.085650 16512 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:51.090524 16512 catalog_manager.cc:1398] Generated new cluster ID: da4585472dfa47b1a0fbf2957a355619
I20261118 03:02:51.090585 16512 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:51.107245 16512 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:51.108389 16512 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:51.115038 16512 catalog_manager.cc:6221] T 00000000000000000000000000000000 P c0d13e20e59d4eb6a9469bbbb9959475: Generated new TSK 0
I20261118 03:02:51.115737 16512 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:51.120126 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:51.218781 16522 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:51.218994 16522 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:51.219044 16522 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:51.219111 16522 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:51.222422 16522 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:51.222474 16522 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:51.222522 16522 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:51.222606 16522 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:51.222643 16522 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:51.226579 16522 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--never_fsync=true
--heap_profile_path=/tmp/kudu.16522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:51.227320 16522 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:51.228021 16522 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:51.233390 16527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.233491 16522 server_base.cc:1061] running on GCE node
W20261118 03:02:51.233386 16530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.233721 16528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.234102 16522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:51.234720 16522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:51.235872 16522 hybrid_clock.cc:648] HybridClock initialized: now 1794970971235857 us; error 30 us; skew 500 ppm
I20261118 03:02:51.237754 16522 webserver.cc:577] Webserver started at http://127.13.90.65:33529/ using document root <none> and password file <none>
I20261118 03:02:51.238406 16522 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:51.238461 16522 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:51.238677 16522 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:51.240336 16522 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5b97965452614f3baa6d2469194008b8"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.240873 16522 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5b97965452614f3baa6d2469194008b8"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.244638 16522 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.003s
I20261118 03:02:51.246888 16536 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.247799 16522 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20261118 03:02:51.247887 16522 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5b97965452614f3baa6d2469194008b8"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.247954 16522 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:51.267657 16522 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:51.268049 16522 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:51.268160 16522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:51.268586 16522 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:51.269531 16522 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:51.269577 16522 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.269615 16522 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:51.269629 16522 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.277595 16522 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:42595
I20261118 03:02:51.277638 16649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:42595 every 8 connection(s)
I20261118 03:02:51.278502 16522 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 03:02:51.285208 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16522
I20261118 03:02:51.285336 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 03:02:51.285976 16650 heartbeater.cc:345] Connected to a master server at 127.13.90.126:45763
I20261118 03:02:51.286186 16650 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:51.286675 16650 heartbeater.cc:508] Master 127.13.90.126:45763 requested a full tablet report, sending...
I20261118 03:02:51.287565 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:51.288161 16462 ts_manager.cc:210] Registered new tserver with Master: 5b97965452614f3baa6d2469194008b8 (127.13.90.65:42595)
I20261118 03:02:51.289366 16462 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:33115
W20261118 03:02:51.385587 16653 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:51.385784 16653 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:51.385825 16653 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:51.385890 16653 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:51.389196 16653 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:51.389250 16653 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:51.389298 16653 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:51.389385 16653 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:51.389420 16653 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:51.393319 16653 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--never_fsync=true
--heap_profile_path=/tmp/kudu.16653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:51.394076 16653 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:51.394753 16653 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:51.400313 16661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.400372 16659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.400436 16658 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.400722 16653 server_base.cc:1061] running on GCE node
I20261118 03:02:51.401036 16653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:51.401567 16653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:51.402726 16653 hybrid_clock.cc:648] HybridClock initialized: now 1794970971402711 us; error 28 us; skew 500 ppm
I20261118 03:02:51.404453 16653 webserver.cc:577] Webserver started at http://127.13.90.66:34823/ using document root <none> and password file <none>
I20261118 03:02:51.405035 16653 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:51.405083 16653 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:51.405284 16653 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:51.406558 16653 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "4b7f58488c0740d4bc998c5c39a4eb76"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.406965 16653 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "4b7f58488c0740d4bc998c5c39a4eb76"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.410073 16653 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:51.412338 16667 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.413344 16653 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:51.413442 16653 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "4b7f58488c0740d4bc998c5c39a4eb76"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.413544 16653 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:51.446146 16653 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:51.446601 16653 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:51.446731 16653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:51.447243 16653 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:51.448207 16653 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:51.448253 16653 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.448298 16653 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:51.448328 16653 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.456444 16653 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:38139
I20261118 03:02:51.456482 16780 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:38139 every 8 connection(s)
I20261118 03:02:51.457434 16653 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 03:02:51.462961 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16653
I20261118 03:02:51.463093 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 03:02:51.464747 16781 heartbeater.cc:345] Connected to a master server at 127.13.90.126:45763
I20261118 03:02:51.464952 16781 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:51.465464 16781 heartbeater.cc:508] Master 127.13.90.126:45763 requested a full tablet report, sending...
I20261118 03:02:51.465500 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:51.466569 16462 ts_manager.cc:210] Registered new tserver with Master: 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139)
I20261118 03:02:51.467157 16462 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:36207
W20261118 03:02:51.565140 16784 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:51.565341 16784 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:51.565379 16784 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:51.565444 16784 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:51.568759 16784 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:51.568807 16784 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:51.568856 16784 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:51.568953 16784 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:51.568988 16784 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:51.572888 16784 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--never_fsync=true
--heap_profile_path=/tmp/kudu.16784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:51.573601 16784 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:51.574265 16784 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:51.579684 16789 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.579670 16790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.579846 16784 server_base.cc:1061] running on GCE node
W20261118 03:02:51.579670 16792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.580191 16784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:51.580726 16784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:51.581892 16784 hybrid_clock.cc:648] HybridClock initialized: now 1794970971581878 us; error 27 us; skew 500 ppm
I20261118 03:02:51.583565 16784 webserver.cc:577] Webserver started at http://127.13.90.67:45831/ using document root <none> and password file <none>
I20261118 03:02:51.584095 16784 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:51.584144 16784 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:51.584343 16784 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:51.585606 16784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "8cedd53e3ba3448bbd0cd31e7783b582"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.586027 16784 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "8cedd53e3ba3448bbd0cd31e7783b582"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.589054 16784 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20261118 03:02:51.591140 16798 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.592016 16784 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:51.592114 16784 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "8cedd53e3ba3448bbd0cd31e7783b582"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.592186 16784 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:51.611627 16784 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:51.612036 16784 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:51.612166 16784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:51.612725 16784 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:51.613634 16784 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:51.613679 16784 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.613734 16784 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:51.613762 16784 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.621994 16784 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:41363
I20261118 03:02:51.622007 16911 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:41363 every 8 connection(s)
I20261118 03:02:51.622879 16784 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 03:02:51.629927 16912 heartbeater.cc:345] Connected to a master server at 127.13.90.126:45763
I20261118 03:02:51.630098 16912 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:51.630537 16912 heartbeater.cc:508] Master 127.13.90.126:45763 requested a full tablet report, sending...
I20261118 03:02:51.630563 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16784
I20261118 03:02:51.630647 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 03:02:51.631671 16462 ts_manager.cc:210] Registered new tserver with Master: 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67:41363)
I20261118 03:02:51.632268 16462 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:55485
I20261118 03:02:51.632956 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:0
--local_ip_for_outbound_sockets=127.13.90.68
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:51.728477 16915 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:51.728698 16915 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:51.728734 16915 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:51.728791 16915 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:51.731992 16915 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:51.732038 16915 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:51.732069 16915 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:51.732128 16915 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:51.732155 16915 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:51.735955 16915 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:45763
--never_fsync=true
--heap_profile_path=/tmp/kudu.16915
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:51.736747 16915 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:51.737428 16915 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:51.742834 16921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.742877 16920 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:51.742821 16923 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:51.743065 16915 server_base.cc:1061] running on GCE node
I20261118 03:02:51.743381 16915 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:51.743852 16915 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:51.744985 16915 hybrid_clock.cc:648] HybridClock initialized: now 1794970971744971 us; error 26 us; skew 500 ppm
I20261118 03:02:51.746394 16915 webserver.cc:577] Webserver started at http://127.13.90.68:36147/ using document root <none> and password file <none>
I20261118 03:02:51.746944 16915 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:51.747004 16915 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:51.747197 16915 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:51.748384 16915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "69b448e63ba84ece9c8ffb8e887bb894"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.748908 16915 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "69b448e63ba84ece9c8ffb8e887bb894"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.751801 16915 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20261118 03:02:51.753888 16929 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.754776 16915 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20261118 03:02:51.754870 16915 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "69b448e63ba84ece9c8ffb8e887bb894"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:51.754944 16915 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:51.779238 16915 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:51.779656 16915 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:51.779783 16915 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:51.780229 16915 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:51.781169 16915 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:51.781213 16915 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.781255 16915 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:51.781275 16915 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:51.789310 16915 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:33467
I20261118 03:02:51.789353 17042 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:33467 every 8 connection(s)
I20261118 03:02:51.790244 16915 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 03:02:51.797331 17043 heartbeater.cc:345] Connected to a master server at 127.13.90.126:45763
I20261118 03:02:51.797533 17043 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:51.797773 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 16915
I20261118 03:02:51.797860 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 03:02:51.797999 17043 heartbeater.cc:508] Master 127.13.90.126:45763 requested a full tablet report, sending...
I20261118 03:02:51.799031 16462 ts_manager.cc:210] Registered new tserver with Master: 69b448e63ba84ece9c8ffb8e887bb894 (127.13.90.68:33467)
I20261118 03:02:51.799579 16462 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:39589
I20261118 03:02:51.800948 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:51.809185 16462 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40608:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 03:02:51.829322 16977 tablet_service.cc:1500] Processing CreateTablet for tablet 723de7226b884a699df7b77ff8596a1c (DEFAULT_TABLE table=TestTable [id=cd3f6b5f6c774a4b84abc3d690bce333]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:51.829417 16715 tablet_service.cc:1500] Processing CreateTablet for tablet 723de7226b884a699df7b77ff8596a1c (DEFAULT_TABLE table=TestTable [id=cd3f6b5f6c774a4b84abc3d690bce333]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:51.829417 16583 tablet_service.cc:1500] Processing CreateTablet for tablet 723de7226b884a699df7b77ff8596a1c (DEFAULT_TABLE table=TestTable [id=cd3f6b5f6c774a4b84abc3d690bce333]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:51.830200 16977 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723de7226b884a699df7b77ff8596a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:51.830317 16583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723de7226b884a699df7b77ff8596a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:51.830317 16715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723de7226b884a699df7b77ff8596a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:51.835213 17060 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Bootstrap starting.
I20261118 03:02:51.836440 17062 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Bootstrap starting.
I20261118 03:02:51.837642 17060 tablet_bootstrap.cc:654] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:51.838275 17062 tablet_bootstrap.cc:654] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:51.838392 17060 log.cc:826] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:51.838981 17061 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Bootstrap starting.
I20261118 03:02:51.839053 17062 log.cc:826] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:51.839861 17060 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: No bootstrap required, opened a new log
I20261118 03:02:51.840070 17060 ts_tablet_manager.cc:1449] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:51.840265 17062 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: No bootstrap required, opened a new log
I20261118 03:02:51.840445 17062 ts_tablet_manager.cc:1449] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20261118 03:02:51.841163 17061 tablet_bootstrap.cc:654] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:51.841938 17061 log.cc:826] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:51.843101 17060 raft_consensus.cc:360] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.843097 17062 raft_consensus.cc:360] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.843267 17060 raft_consensus.cc:386] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:51.843282 17062 raft_consensus.cc:386] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:51.843330 17062 raft_consensus.cc:748] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7f58488c0740d4bc998c5c39a4eb76, State: Initialized, Role: FOLLOWER
I20261118 03:02:51.843340 17060 raft_consensus.cc:748] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69b448e63ba84ece9c8ffb8e887bb894, State: Initialized, Role: FOLLOWER
I20261118 03:02:51.843374 17061 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: No bootstrap required, opened a new log
I20261118 03:02:51.843552 17061 ts_tablet_manager.cc:1449] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:51.843762 17060 consensus_queue.cc:261] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.843780 17062 consensus_queue.cc:261] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.844350 17043 heartbeater.cc:500] Master 127.13.90.126:45763 was elected leader, sending a full tablet report...
I20261118 03:02:51.844488 17060 ts_tablet_manager.cc:1480] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:51.844492 17062 ts_tablet_manager.cc:1480] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:51.844820 16781 heartbeater.cc:500] Master 127.13.90.126:45763 was elected leader, sending a full tablet report...
I20261118 03:02:51.846429 17061 raft_consensus.cc:360] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.846590 17061 raft_consensus.cc:386] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:51.846642 17061 raft_consensus.cc:748] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b97965452614f3baa6d2469194008b8, State: Initialized, Role: FOLLOWER
I20261118 03:02:51.846969 17061 consensus_queue.cc:261] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.847651 17061 ts_tablet_manager.cc:1480] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:51.847923 16650 heartbeater.cc:500] Master 127.13.90.126:45763 was elected leader, sending a full tablet report...
W20261118 03:02:51.858687 16782 tablet.cc:2441] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:51.880218 16651 tablet.cc:2441] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20261118 03:02:51.891021 17044 tablet.cc:2441] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:51.924022 17067 raft_consensus.cc:499] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:51.924206 17067 raft_consensus.cc:521] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.925436 17067 leader_election.cc:290] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69b448e63ba84ece9c8ffb8e887bb894 (127.13.90.68:33467), 5b97965452614f3baa6d2469194008b8 (127.13.90.65:42595)
I20261118 03:02:51.929158 16604 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b97965452614f3baa6d2469194008b8" is_pre_election: true
I20261118 03:02:51.929412 16604 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7f58488c0740d4bc998c5c39a4eb76 in term 0.
I20261118 03:02:51.929613 16997 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b448e63ba84ece9c8ffb8e887bb894" is_pre_election: true
I20261118 03:02:51.929864 16997 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4b7f58488c0740d4bc998c5c39a4eb76 in term 0.
I20261118 03:02:51.929859 16671 leader_election.cc:304] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7f58488c0740d4bc998c5c39a4eb76, 5b97965452614f3baa6d2469194008b8; no voters: 
I20261118 03:02:51.930094 17067 raft_consensus.cc:2826] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 03:02:51.930157 17067 raft_consensus.cc:499] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:51.930205 17067 raft_consensus.cc:3096] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:51.931080 17067 raft_consensus.cc:521] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.931387 17067 leader_election.cc:290] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [CANDIDATE]: Term 1 election: Requested vote from peers 69b448e63ba84ece9c8ffb8e887bb894 (127.13.90.68:33467), 5b97965452614f3baa6d2469194008b8 (127.13.90.65:42595)
I20261118 03:02:51.931710 16604 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b97965452614f3baa6d2469194008b8"
I20261118 03:02:51.931735 16997 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69b448e63ba84ece9c8ffb8e887bb894"
I20261118 03:02:51.931813 16604 raft_consensus.cc:3096] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:51.931843 16997 raft_consensus.cc:3096] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:51.932611 16997 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7f58488c0740d4bc998c5c39a4eb76 in term 1.
I20261118 03:02:51.932924 16668 leader_election.cc:304] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4b7f58488c0740d4bc998c5c39a4eb76, 69b448e63ba84ece9c8ffb8e887bb894; no voters: 
I20261118 03:02:51.933094 17067 raft_consensus.cc:2826] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:51.933101 16604 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4b7f58488c0740d4bc998c5c39a4eb76 in term 1.
I20261118 03:02:51.933274 17067 raft_consensus.cc:705] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 1 LEADER]: Becoming Leader. State: Replica: 4b7f58488c0740d4bc998c5c39a4eb76, State: Running, Role: LEADER
I20261118 03:02:51.933645 17067 consensus_queue.cc:238] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:51.936697 16461 catalog_manager.cc:5840] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66). New cstate: current_term: 1 leader_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } health_report { overall_health: UNKNOWN } } }
I20261118 03:02:51.937310 17067 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:51.937463 17072 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:51.944031 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:51.945708 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 5b97965452614f3baa6d2469194008b8 to finish bootstrapping
I20261118 03:02:51.950297 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 4b7f58488c0740d4bc998c5c39a4eb76 to finish bootstrapping
I20261118 03:02:51.954607 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 69b448e63ba84ece9c8ffb8e887bb894 to finish bootstrapping
I20261118 03:02:51.958868 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16653
I20261118 03:02:52.634122 16912 heartbeater.cc:500] Master 127.13.90.126:45763 was elected leader, sending a full tablet report...
I20261118 03:02:53.443055 17080 raft_consensus.cc:499] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7f58488c0740d4bc998c5c39a4eb76)
I20261118 03:02:53.443208 17080 raft_consensus.cc:521] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:53.444265 17080 leader_election.cc:290] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 69b448e63ba84ece9c8ffb8e887bb894 (127.13.90.68:33467), 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139)
I20261118 03:02:53.444847 17081 raft_consensus.cc:499] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4b7f58488c0740d4bc998c5c39a4eb76)
W20261118 03:02:53.444919 16539 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:53.444960 17081 raft_consensus.cc:521] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
W20261118 03:02:53.445698 16539 leader_election.cc:336] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:53.446059 17081 leader_election.cc:290] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139), 5b97965452614f3baa6d2469194008b8 (127.13.90.65:42595)
W20261118 03:02:53.446547 16932 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
W20261118 03:02:53.447224 16932 leader_election.cc:336] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:53.448491 16997 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "5b97965452614f3baa6d2469194008b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69b448e63ba84ece9c8ffb8e887bb894" is_pre_election: true
I20261118 03:02:53.448599 16997 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b97965452614f3baa6d2469194008b8 in term 1.
I20261118 03:02:53.448915 16537 leader_election.cc:304] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b97965452614f3baa6d2469194008b8, 69b448e63ba84ece9c8ffb8e887bb894; no voters: 4b7f58488c0740d4bc998c5c39a4eb76
I20261118 03:02:53.449113 17080 raft_consensus.cc:2826] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 03:02:53.449172 17080 raft_consensus.cc:499] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4b7f58488c0740d4bc998c5c39a4eb76)
I20261118 03:02:53.449208 17080 raft_consensus.cc:3096] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:53.450032 16604 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "69b448e63ba84ece9c8ffb8e887bb894" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5b97965452614f3baa6d2469194008b8" is_pre_election: true
I20261118 03:02:53.450070 17080 raft_consensus.cc:521] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:53.450269 16604 raft_consensus.cc:2415] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 69b448e63ba84ece9c8ffb8e887bb894 in current term 2: Already voted for candidate 5b97965452614f3baa6d2469194008b8 in this term.
I20261118 03:02:53.450379 17080 leader_election.cc:290] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 election: Requested vote from peers 69b448e63ba84ece9c8ffb8e887bb894 (127.13.90.68:33467), 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139)
I20261118 03:02:53.450664 16933 leader_election.cc:304] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 69b448e63ba84ece9c8ffb8e887bb894; no voters: 4b7f58488c0740d4bc998c5c39a4eb76, 5b97965452614f3baa6d2469194008b8
I20261118 03:02:53.450670 16997 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "723de7226b884a699df7b77ff8596a1c" candidate_uuid: "5b97965452614f3baa6d2469194008b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "69b448e63ba84ece9c8ffb8e887bb894"
I20261118 03:02:53.450799 16997 raft_consensus.cc:3096] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 1 FOLLOWER]: Advancing to term 2
W20261118 03:02:53.451239 16539 leader_election.cc:336] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:53.451579 16997 raft_consensus.cc:2490] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b97965452614f3baa6d2469194008b8 in term 2.
I20261118 03:02:53.451713 17081 raft_consensus.cc:2771] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20261118 03:02:53.451833 16537 leader_election.cc:304] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5b97965452614f3baa6d2469194008b8, 69b448e63ba84ece9c8ffb8e887bb894; no voters: 4b7f58488c0740d4bc998c5c39a4eb76
I20261118 03:02:53.451994 17080 raft_consensus.cc:2826] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 FOLLOWER]: Leader election won for term 2
I20261118 03:02:53.452175 17080 raft_consensus.cc:705] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 LEADER]: Becoming Leader. State: Replica: 5b97965452614f3baa6d2469194008b8, State: Running, Role: LEADER
I20261118 03:02:53.452490 17080 consensus_queue.cc:238] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:53.454694 16997 raft_consensus.cc:1285] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Refusing update from remote peer 5b97965452614f3baa6d2469194008b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20261118 03:02:53.454828 16539 consensus_peers.cc:597] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 -> Peer 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): Couldn't send request to peer 4b7f58488c0740d4bc998c5c39a4eb76. Status: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:53.455066 16460 catalog_manager.cc:5840] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 reported cstate change: term changed from 1 to 2, leader changed from 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66) to 5b97965452614f3baa6d2469194008b8 (127.13.90.65). New cstate: current_term: 2 leader_uuid: "5b97965452614f3baa6d2469194008b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } health_report { overall_health: HEALTHY } } }
I20261118 03:02:53.455940 17092 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 03:02:53.502389 13673 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20261118 03:02:53.502664 13673 raft_consensus-itest-base.cc:268] Waiting until we've written at least 4MB...
I20261118 03:02:53.578425 13673 raft_consensus-itest-base.cc:274] Waiting for log GC on 5b97965452614f3baa6d2469194008b8
I20261118 03:02:53.586122 16651 maintenance_manager.cc:419] P 5b97965452614f3baa6d2469194008b8: Scheduling FlushMRSOp(723de7226b884a699df7b77ff8596a1c): 4602312 bytes log retention, and flush 6119689 bytes memory
I20261118 03:02:53.596812 17044 maintenance_manager.cc:419] P 69b448e63ba84ece9c8ffb8e887bb894: Scheduling FlushMRSOp(723de7226b884a699df7b77ff8596a1c): 4339200 bytes log retention, and flush 6119689 bytes memory
I20261118 03:02:53.649873 16541 maintenance_manager.cc:643] P 5b97965452614f3baa6d2469194008b8: FlushMRSOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.063s	user 0.059s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":213,"dirs.queue_time_us":4787,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":612,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":37,"thread_start_us":247,"threads_started":2}
I20261118 03:02:53.650959 16651 maintenance_manager.cc:419] P 5b97965452614f3baa6d2469194008b8: Scheduling LogGCOp(723de7226b884a699df7b77ff8596a1c): free 2761400 bytes of WAL
I20261118 03:02:53.651327 16541 log_reader.cc:385] T 723de7226b884a699df7b77ff8596a1c: removed 3 log segments from log reader
I20261118 03:02:53.651458 16541 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000001 (ops 1-9)
I20261118 03:02:53.651585 16541 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000002 (ops 10-16)
I20261118 03:02:53.651682 16541 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000003 (ops 17-23)
I20261118 03:02:53.652599 16541 maintenance_manager.cc:643] P 5b97965452614f3baa6d2469194008b8: LogGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:02:53.652931 16651 maintenance_manager.cc:419] P 5b97965452614f3baa6d2469194008b8: Scheduling UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c): 550 bytes on disk
I20261118 03:02:53.653493 16541 maintenance_manager.cc:643] P 5b97965452614f3baa6d2469194008b8: UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4}
I20261118 03:02:53.660259 13673 raft_consensus-itest-base.cc:279] Log GC complete on 5b97965452614f3baa6d2469194008b8
I20261118 03:02:53.660701 16934 maintenance_manager.cc:643] P 69b448e63ba84ece9c8ffb8e887bb894: FlushMRSOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.063s	user 0.061s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":223,"dirs.queue_time_us":434,"dirs.run_cpu_time_us":177,"dirs.run_wall_time_us":620,"drs_written":1,"lbm_read_time_us":61,"lbm_reads_lt_1ms":4,"lbm_write_time_us":608,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":37,"thread_start_us":231,"threads_started":2}
I20261118 03:02:53.661415 17044 maintenance_manager.cc:419] P 69b448e63ba84ece9c8ffb8e887bb894: Scheduling LogGCOp(723de7226b884a699df7b77ff8596a1c): free 2629855 bytes of WAL
I20261118 03:02:53.661655 16934 log_reader.cc:385] T 723de7226b884a699df7b77ff8596a1c: removed 3 log segments from log reader
I20261118 03:02:53.661716 16934 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000001 (ops 1-9)
I20261118 03:02:53.661813 16934 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000002 (ops 10-15)
I20261118 03:02:53.661851 16934 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000003 (ops 16-22)
I20261118 03:02:53.662659 16934 maintenance_manager.cc:643] P 69b448e63ba84ece9c8ffb8e887bb894: LogGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:02:53.662917 17044 maintenance_manager.cc:419] P 69b448e63ba84ece9c8ffb8e887bb894: Scheduling UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c): 550 bytes on disk
I20261118 03:02:53.663409 16934 maintenance_manager.cc:643] P 69b448e63ba84ece9c8ffb8e887bb894: UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":57,"lbm_reads_lt_1ms":4}
I20261118 03:02:54.022313 17080 consensus_queue.cc:754] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: The logs necessary to catch up peer 4b7f58488c0740d4bc998c5c39a4eb76 have been garbage collected. The follower will never be able to catch up (Not found: failed to read ops 2..32: Segment 1 which contained index 2 has been GCed)
I20261118 03:02:54.022404 17080 consensus_queue.cc:580] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: The logs necessary to catch up peer 4b7f58488c0740d4bc998c5c39a4eb76 have been garbage collected. The replica will never be able to catch up
I20261118 03:02:54.025398 16604 consensus_queue.cc:238] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 2.39, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:54.026549 16996 raft_consensus.cc:1285] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Refusing update from remote peer 5b97965452614f3baa6d2469194008b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 39. Preceding OpId from leader: term: 2 index: 40. (index mismatch)
I20261118 03:02:54.027004 17080 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20261118 03:02:54.028616 17092 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 LEADER]: Committing config change with OpId 2.40: config changed from index -1 to 40, VOTER 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66) evicted. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } }
I20261118 03:02:54.029042 16996 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Committing config change with OpId 2.40: config changed from index -1 to 40, VOTER 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66) evicted. New config: { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } }
I20261118 03:02:54.030827 16449 catalog_manager.cc:5247] ChangeConfig:REMOVE_PEER RPC for tablet 723de7226b884a699df7b77ff8596a1c with cas_config_opid_index -1: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20261118 03:02:54.031020 16461 catalog_manager.cc:5840] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 reported cstate change: config changed from index -1 to 40, VOTER 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66) evicted. New cstate: current_term: 2 leader_uuid: "5b97965452614f3baa6d2469194008b8" committed_config { opid_index: 40 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } health_report { overall_health: HEALTHY } } }
W20261118 03:02:54.033905 16448 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
W20261118 03:02:54.034653 16448 catalog_manager.cc:4792] TS 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 723de7226b884a699df7b77ff8596a1c: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:54.034672 16604 consensus_queue.cc:238] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.40, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } }
I20261118 03:02:54.036036 16996 raft_consensus.cc:1285] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Refusing update from remote peer 5b97965452614f3baa6d2469194008b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 40. Preceding OpId from leader: term: 2 index: 41. (index mismatch)
I20261118 03:02:54.036499 17080 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20261118 03:02:54.037901 17092 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 LEADER]: Committing config change with OpId 2.41: config changed from index 40 to 41, NON_VOTER 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) added. New config: { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } } }
I20261118 03:02:54.038313 16996 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Committing config change with OpId 2.41: config changed from index 40 to 41, NON_VOTER 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) added. New config: { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } } }
I20261118 03:02:54.040112 16449 catalog_manager.cc:5247] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 723de7226b884a699df7b77ff8596a1c with cas_config_opid_index 40: ChangeConfig:ADD_PEER:NON_VOTER succeeded (attempt 1)
I20261118 03:02:54.040686 16460 catalog_manager.cc:5840] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 reported cstate change: config changed from index 40 to 41, NON_VOTER 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) added. New cstate: current_term: 2 leader_uuid: "5b97965452614f3baa6d2469194008b8" committed_config { opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } } }
W20261118 03:02:54.041253 16539 consensus_peers.cc:597] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 -> Peer 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67:41363): Couldn't send request to peer 8cedd53e3ba3448bbd0cd31e7783b582. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 723de7226b884a699df7b77ff8596a1c. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:02:54.486474 17131 ts_tablet_manager.cc:979] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Initiating tablet copy from peer 5b97965452614f3baa6d2469194008b8 (127.13.90.65:42595)
I20261118 03:02:54.487012 17131 tablet_copy_client.cc:323] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: tablet copy: Beginning tablet copy session from remote peer at address 127.13.90.65:42595
I20261118 03:02:54.490507 16624 tablet_copy_service.cc:140] P 5b97965452614f3baa6d2469194008b8: Received BeginTabletCopySession request for tablet 723de7226b884a699df7b77ff8596a1c from peer 8cedd53e3ba3448bbd0cd31e7783b582 ({username='slave'} at 127.13.90.67:44097)
I20261118 03:02:54.490635 16624 tablet_copy_service.cc:161] P 5b97965452614f3baa6d2469194008b8: Beginning new tablet copy session on tablet 723de7226b884a699df7b77ff8596a1c from peer 8cedd53e3ba3448bbd0cd31e7783b582 at {username='slave'} at 127.13.90.67:44097: session id = 8cedd53e3ba3448bbd0cd31e7783b582-723de7226b884a699df7b77ff8596a1c
I20261118 03:02:54.492144 16624 tablet_copy_source_session.cc:215] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Tablet Copy: opened 5 blocks and 3 log segments
I20261118 03:02:54.495855 17131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 723de7226b884a699df7b77ff8596a1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:54.500290 17131 tablet_copy_client.cc:806] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: tablet copy: Starting download of 5 data blocks...
I20261118 03:02:54.506593 17131 tablet_copy_client.cc:670] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: tablet copy: Starting download of 3 WAL segments...
I20261118 03:02:54.514750 17131 tablet_copy_client.cc:538] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20261118 03:02:54.516992 17131 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Bootstrap starting.
I20261118 03:02:54.524211 17131 log.cc:826] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:54.530659 17131 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Bootstrap replayed 1/3 log segments. Stats: ops{read=7 overwritten=0 applied=5 ignored=5} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=2. Pending: 2 replicates
I20261118 03:02:54.534721 17131 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Bootstrap replayed 2/3 log segments. Stats: ops{read=14 overwritten=0 applied=12 ignored=12} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=2. Pending: 2 replicates
I20261118 03:02:54.537081 17131 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Bootstrap replayed 3/3 log segments. Stats: ops{read=18 overwritten=0 applied=18 ignored=16} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=2. Pending: 0 replicates
I20261118 03:02:54.537379 17131 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Bootstrap complete.
I20261118 03:02:54.537988 17131 ts_tablet_manager.cc:1449] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Time spent bootstrapping tablet: real 0.021s	user 0.019s	sys 0.000s
I20261118 03:02:54.540081 17131 raft_consensus.cc:360] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } }
I20261118 03:02:54.540277 17131 raft_consensus.cc:748] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 8cedd53e3ba3448bbd0cd31e7783b582, State: Initialized, Role: LEARNER
I20261118 03:02:54.540602 17131 consensus_queue.cc:261] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 41, Last appended: 2.41, Last appended by leader: 41, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 41 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: NON_VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: true } }
I20261118 03:02:54.541364 17131 ts_tablet_manager.cc:1480] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Time spent starting tablet: real 0.003s	user 0.004s	sys 0.000s
I20261118 03:02:54.542135 16624 tablet_copy_service.cc:342] P 5b97965452614f3baa6d2469194008b8: Request end of tablet copy session 8cedd53e3ba3448bbd0cd31e7783b582-723de7226b884a699df7b77ff8596a1c received from {username='slave'} at 127.13.90.67:44097
I20261118 03:02:54.542227 16624 tablet_copy_service.cc:434] P 5b97965452614f3baa6d2469194008b8: ending tablet copy session 8cedd53e3ba3448bbd0cd31e7783b582-723de7226b884a699df7b77ff8596a1c on tablet 723de7226b884a699df7b77ff8596a1c with peer 8cedd53e3ba3448bbd0cd31e7783b582
I20261118 03:02:54.630137 16913 maintenance_manager.cc:419] P 8cedd53e3ba3448bbd0cd31e7783b582: Scheduling UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c): 550 bytes on disk
I20261118 03:02:54.631022 16803 maintenance_manager.cc:643] P 8cedd53e3ba3448bbd0cd31e7783b582: UndoDeltaBlockGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4}
I20261118 03:02:54.865367 16866 raft_consensus.cc:1227] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.40->[2.41-2.41]   Dedup: 2.41->[]
I20261118 03:02:54.958242 16651 maintenance_manager.cc:419] P 5b97965452614f3baa6d2469194008b8: Scheduling LogGCOp(723de7226b884a699df7b77ff8596a1c): free 1840912 bytes of WAL
I20261118 03:02:54.958513 16541 log_reader.cc:385] T 723de7226b884a699df7b77ff8596a1c: removed 2 log segments from log reader
I20261118 03:02:54.958573 16541 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000004 (ops 24-30)
I20261118 03:02:54.958606 16541 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000005 (ops 31-37)
I20261118 03:02:54.959088 16541 maintenance_manager.cc:643] P 5b97965452614f3baa6d2469194008b8: LogGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:02:54.967839 17044 maintenance_manager.cc:419] P 69b448e63ba84ece9c8ffb8e887bb894: Scheduling LogGCOp(723de7226b884a699df7b77ff8596a1c): free 1709345 bytes of WAL
I20261118 03:02:54.968098 16934 log_reader.cc:385] T 723de7226b884a699df7b77ff8596a1c: removed 2 log segments from log reader
I20261118 03:02:54.968153 16934 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000004 (ops 23-29)
I20261118 03:02:54.968192 16934 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000005 (ops 30-35)
I20261118 03:02:54.968642 16934 maintenance_manager.cc:643] P 69b448e63ba84ece9c8ffb8e887bb894: LogGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
W20261118 03:02:55.245209 16448 catalog_manager.cc:4792] TS 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 723de7226b884a699df7b77ff8596a1c: Network error: Client connection negotiation failed: client connection to 127.13.90.66:38139: connect: Connection refused (error 111)
I20261118 03:02:55.264272 17140 raft_consensus.cc:1074] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8: attempting to promote NON_VOTER 8cedd53e3ba3448bbd0cd31e7783b582 to VOTER
I20261118 03:02:55.264750 17140 consensus_queue.cc:238] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 2.41, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false } }
I20261118 03:02:55.265969 16996 raft_consensus.cc:1285] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Refusing update from remote peer 5b97965452614f3baa6d2469194008b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 41. Preceding OpId from leader: term: 2 index: 42. (index mismatch)
I20261118 03:02:55.266108 16866 raft_consensus.cc:1285] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [term 2 LEARNER]: Refusing update from remote peer 5b97965452614f3baa6d2469194008b8: Log matching property violated. Preceding OpId in replica: term: 2 index: 41. Preceding OpId from leader: term: 2 index: 42. (index mismatch)
I20261118 03:02:55.266386 17090 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20261118 03:02:55.266535 17140 consensus_queue.cc:1049] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20261118 03:02:55.268226 17140 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 [term 2 LEADER]: Committing config change with OpId 2.42: config changed from index 41 to 42, 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) changed from NON_VOTER to VOTER. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false } } }
I20261118 03:02:55.268601 16996 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 69b448e63ba84ece9c8ffb8e887bb894 [term 2 FOLLOWER]: Committing config change with OpId 2.42: config changed from index 41 to 42, 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) changed from NON_VOTER to VOTER. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false } } }
I20261118 03:02:55.269855 16866 raft_consensus.cc:2983] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582 [term 2 FOLLOWER]: Committing config change with OpId 2.42: config changed from index 41 to 42, 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) changed from NON_VOTER to VOTER. New config: { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false } } }
I20261118 03:02:55.270867 16461 catalog_manager.cc:5840] T 723de7226b884a699df7b77ff8596a1c P 5b97965452614f3baa6d2469194008b8 reported cstate change: config changed from index 41 to 42, 8cedd53e3ba3448bbd0cd31e7783b582 (127.13.90.67) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5b97965452614f3baa6d2469194008b8" committed_config { opid_index: 42 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8cedd53e3ba3448bbd0cd31e7783b582" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 41363 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20261118 03:02:55.334334 16913 maintenance_manager.cc:419] P 8cedd53e3ba3448bbd0cd31e7783b582: Scheduling LogGCOp(723de7226b884a699df7b77ff8596a1c): free 1840860 bytes of WAL
I20261118 03:02:55.334661 16803 log_reader.cc:385] T 723de7226b884a699df7b77ff8596a1c: removed 2 log segments from log reader
I20261118 03:02:55.334728 16803 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000001 (ops 24-30)
I20261118 03:02:55.334790 16803 log.cc:1079] T 723de7226b884a699df7b77ff8596a1c P 8cedd53e3ba3448bbd0cd31e7783b582: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/723de7226b884a699df7b77ff8596a1c/wal-000000002 (ops 31-37)
I20261118 03:02:55.335284 16803 maintenance_manager.cc:643] P 8cedd53e3ba3448bbd0cd31e7783b582: LogGCOp(723de7226b884a699df7b77ff8596a1c) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:02:55.661614 13673 raft_consensus-itest-base.cc:295] Servers converged with original term 2
I20261118 03:02:55.661681 13673 raft_consensus-itest-base.cc:303] Restarting 4b7f58488c0740d4bc998c5c39a4eb76
I20261118 03:02:55.662011 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:38139
--local_ip_for_outbound_sockets=127.13.90.66
--tserver_master_addrs=127.13.90.126:45763
--webserver_port=34823
--webserver_interface=127.13.90.66
--builtin_ntp_servers=127.13.90.84:33421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:55.761869 17151 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:55.762109 17151 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:55.762149 17151 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:55.762214 17151 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:55.765580 17151 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:55.765633 17151 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:55.765682 17151 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:55.765779 17151 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:55.765822 17151 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:55.769701 17151 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:33421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:38139
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=34823
--tserver_master_addrs=127.13.90.126:45763
--never_fsync=true
--heap_profile_path=/tmp/kudu.17151
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:55.770449 17151 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:55.771135 17151 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:55.776722 17156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:55.776726 17157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:55.776842 17159 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:55.777099 17151 server_base.cc:1061] running on GCE node
I20261118 03:02:55.777424 17151 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:55.777947 17151 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:55.779115 17151 hybrid_clock.cc:648] HybridClock initialized: now 1794970975779088 us; error 39 us; skew 500 ppm
I20261118 03:02:55.780867 17151 webserver.cc:577] Webserver started at http://127.13.90.66:34823/ using document root <none> and password file <none>
I20261118 03:02:55.781427 17151 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:55.781502 17151 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:55.784729 17151 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.003s
I20261118 03:02:55.786819 17165 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:55.787741 17151 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:55.787845 17151 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "4b7f58488c0740d4bc998c5c39a4eb76"
format_stamp: "Formatted at 2026-11-18 03:02:51 on dist-test-slave-m226"
I20261118 03:02:55.788213 17151 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:55.801265 17151 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:55.801712 17151 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:55.801846 17151 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:55.802306 17151 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:55.803516 17172 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 03:02:55.807133 17151 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 03:02:55.807195 17151 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 03:02:55.807265 17151 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 03:02:55.808849 17151 ts_tablet_manager.cc:662] Registered 1 tablets
I20261118 03:02:55.808894 17151 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:55.809263 17172 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Bootstrap starting.
I20261118 03:02:55.818696 17172 log.cc:826] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:55.820256 17151 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:38139
I20261118 03:02:55.820868 17281 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:38139 every 8 connection(s)
I20261118 03:02:55.821477 17151 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehind.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 03:02:55.822683 17172 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 03:02:55.823010 17172 tablet_bootstrap.cc:492] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Bootstrap complete.
I20261118 03:02:55.823369 17172 ts_tablet_manager.cc:1449] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20261118 03:02:55.826062 17172 raft_consensus.cc:360] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:55.826421 17172 raft_consensus.cc:748] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b7f58488c0740d4bc998c5c39a4eb76, State: Initialized, Role: FOLLOWER
I20261118 03:02:55.826881 17172 consensus_queue.cc:261] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69b448e63ba84ece9c8ffb8e887bb894" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 33467 } } peers { permanent_uuid: "4b7f58488c0740d4bc998c5c39a4eb76" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 38139 } } peers { permanent_uuid: "5b97965452614f3baa6d2469194008b8" member_type: VOTER last_known_addr { host: "127.13.90.65" port: 42595 } }
I20261118 03:02:55.827468 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17151
I20261118 03:02:55.827675 17172 ts_tablet_manager.cc:1480] T 723de7226b884a699df7b77ff8596a1c P 4b7f58488c0740d4bc998c5c39a4eb76: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20261118 03:02:55.830289 17282 heartbeater.cc:345] Connected to a master server at 127.13.90.126:45763
I20261118 03:02:55.830500 17282 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:55.831004 17282 heartbeater.cc:508] Master 127.13.90.126:45763 requested a full tablet report, sending...
I20261118 03:02:55.831194 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16522
I20261118 03:02:55.833118 16460 ts_manager.cc:210] Re-registered known tserver with Master: 4b7f58488c0740d4bc998c5c39a4eb76 (127.13.90.66:38139)
I20261118 03:02:55.833938 16460 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:37165
I20261118 03:02:55.835603 17282 heartbeater.cc:500] Master 127.13.90.126:45763 was elected leader, sending a full tablet report...
I20261118 03:02:55.838009 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17151
I20261118 03:02:55.842964 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16784
I20261118 03:02:55.848274 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16915
I20261118 03:02:55.853781 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 16431
2026-11-18T03:02:55Z chronyd exiting
[       OK ] SlowTabletBootstrapTest.TestFallBehind (4971 ms)
[ RUN      ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap
I20261118 03:02:55.876022 13673 ts_itest-base.cc:115] Starting cluster with:
I20261118 03:02:55.876067 13673 ts_itest-base.cc:116] --------------
I20261118 03:02:55.876076 13673 ts_itest-base.cc:117] 4 tablet servers
I20261118 03:02:55.876086 13673 ts_itest-base.cc:118] 3 replicas per TS
I20261118 03:02:55.876096 13673 ts_itest-base.cc:119] --------------
2026-11-18T03:02:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-11-18T03:02:55Z Disabled control of system clock
I20261118 03:02:55.883994 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:34735
--webserver_interface=127.13.90.126
--webserver_port=0
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.13.90.126:34735 with env {}
W20261118 03:02:55.982033 17294 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:55.982199 17294 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:55.982239 17294 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:55.985539 17294 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20261118 03:02:55.985591 17294 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:55.985611 17294 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20261118 03:02:55.985628 17294 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20261118 03:02:55.989732 17294 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.13.90.126:34735
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.13.90.126:34735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
--webserver_interface=127.13.90.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:55.990473 17294 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:55.991171 17294 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:55.995987 17300 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:55.996081 17299 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:55.996196 17294 server_base.cc:1061] running on GCE node
W20261118 03:02:55.996081 17302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:55.996685 17294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:55.997412 17294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:55.998553 17294 hybrid_clock.cc:648] HybridClock initialized: now 1794970975998537 us; error 24 us; skew 500 ppm
I20261118 03:02:56.000054 17294 webserver.cc:577] Webserver started at http://127.13.90.126:45861/ using document root <none> and password file <none>
I20261118 03:02:56.000597 17294 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.000649 17294 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.000885 17294 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:56.002188 17294 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/instance:
uuid: "15747e6ae97d4897b14114c6cb1ff245"
format_stamp: "Formatted at 2026-11-18 03:02:55 on dist-test-slave-m226"
I20261118 03:02:56.002610 17294 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance:
uuid: "15747e6ae97d4897b14114c6cb1ff245"
format_stamp: "Formatted at 2026-11-18 03:02:55 on dist-test-slave-m226"
I20261118 03:02:56.005678 17294 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.002s
I20261118 03:02:56.007938 17308 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.009020 17294 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 03:02:56.009142 17294 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
uuid: "15747e6ae97d4897b14114c6cb1ff245"
format_stamp: "Formatted at 2026-11-18 03:02:55 on dist-test-slave-m226"
I20261118 03:02:56.009234 17294 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:56.020644 17294 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:56.021237 17294 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:56.021386 17294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:56.028023 17294 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.126:34735
I20261118 03:02:56.028029 17360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.126:34735 every 8 connection(s)
I20261118 03:02:56.029103 17294 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/data/info.pb
I20261118 03:02:56.032289 17361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:56.037400 17361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: Bootstrap starting.
I20261118 03:02:56.038550 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17294
I20261118 03:02:56.038663 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/master-0/wal/instance
I20261118 03:02:56.039986 17361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:56.040954 17361 log.cc:826] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:56.042515 17361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: No bootstrap required, opened a new log
I20261118 03:02:56.045359 17361 raft_consensus.cc:360] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } }
I20261118 03:02:56.045533 17361 raft_consensus.cc:386] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:56.045568 17361 raft_consensus.cc:748] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15747e6ae97d4897b14114c6cb1ff245, State: Initialized, Role: FOLLOWER
I20261118 03:02:56.045892 17361 consensus_queue.cc:261] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } }
I20261118 03:02:56.045992 17361 raft_consensus.cc:400] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20261118 03:02:56.046033 17361 raft_consensus.cc:499] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20261118 03:02:56.046092 17361 raft_consensus.cc:3096] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:56.046769 17361 raft_consensus.cc:521] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } }
I20261118 03:02:56.047073 17361 leader_election.cc:304] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15747e6ae97d4897b14114c6cb1ff245; no voters: 
I20261118 03:02:56.047305 17361 leader_election.cc:290] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20261118 03:02:56.047410 17366 raft_consensus.cc:2826] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:56.047605 17366 raft_consensus.cc:705] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [term 1 LEADER]: Becoming Leader. State: Replica: 15747e6ae97d4897b14114c6cb1ff245, State: Running, Role: LEADER
I20261118 03:02:56.047916 17366 consensus_queue.cc:238] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } }
I20261118 03:02:56.048296 17361 sys_catalog.cc:565] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [sys.catalog]: configured and running, proceeding with master startup.
I20261118 03:02:56.049398 17368 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15747e6ae97d4897b14114c6cb1ff245. Latest consensus state: current_term: 1 leader_uuid: "15747e6ae97d4897b14114c6cb1ff245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } } }
I20261118 03:02:56.049512 17368 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [sys.catalog]: This master's current role is: LEADER
I20261118 03:02:56.049379 17367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15747e6ae97d4897b14114c6cb1ff245" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15747e6ae97d4897b14114c6cb1ff245" member_type: VOTER last_known_addr { host: "127.13.90.126" port: 34735 } } }
I20261118 03:02:56.049708 17367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245 [sys.catalog]: This master's current role is: LEADER
W20261118 03:02:56.054097 17381 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20261118 03:02:56.054174 17381 catalog_manager.cc:898] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20261118 03:02:56.054263 17375 catalog_manager.cc:1526] Loading table and tablet metadata into memory...
I20261118 03:02:56.055058 17375 catalog_manager.cc:1535] Initializing Kudu cluster ID...
I20261118 03:02:56.060235 17375 catalog_manager.cc:1398] Generated new cluster ID: de395e63af314b01b4aa379bada20f27
I20261118 03:02:56.060300 17375 catalog_manager.cc:1546] Initializing Kudu internal certificate authority...
I20261118 03:02:56.085439 17375 catalog_manager.cc:1421] Generated new certificate authority record
I20261118 03:02:56.086328 17375 catalog_manager.cc:1555] Loading token signing keys...
I20261118 03:02:56.094022 17375 catalog_manager.cc:6221] T 00000000000000000000000000000000 P 15747e6ae97d4897b14114c6cb1ff245: Generated new TSK 0
I20261118 03:02:56.094671 17375 catalog_manager.cc:1565] Initializing in-progress tserver states...
I20261118 03:02:56.106372 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.65:0
--local_ip_for_outbound_sockets=127.13.90.65
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:56.208336 17385 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:56.208525 17385 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:56.208550 17385 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:56.208611 17385 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:56.212093 17385 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:56.212163 17385 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:56.212214 17385 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:56.212312 17385 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:56.212344 17385 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.65
I20261118 03:02:56.216338 17385 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
--webserver_interface=127.13.90.65
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--never_fsync=true
--heap_profile_path=/tmp/kudu.17385
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:56.217132 17385 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:56.217895 17385 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:56.223661 17393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.223685 17391 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.223698 17390 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.223829 17385 server_base.cc:1061] running on GCE node
I20261118 03:02:56.224185 17385 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:56.224747 17385 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:56.225888 17385 hybrid_clock.cc:648] HybridClock initialized: now 1794970976225870 us; error 29 us; skew 500 ppm
I20261118 03:02:56.227466 17385 webserver.cc:577] Webserver started at http://127.13.90.65:35353/ using document root <none> and password file <none>
I20261118 03:02:56.228065 17385 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.228116 17385 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.228317 17385 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:56.229620 17385 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/instance:
uuid: "5a9952db455442909f56a0eae1deaf17"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.230026 17385 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance:
uuid: "5a9952db455442909f56a0eae1deaf17"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.233274 17385 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20261118 03:02:56.235584 17399 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.236610 17385 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:56.236742 17385 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
uuid: "5a9952db455442909f56a0eae1deaf17"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.236833 17385 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:56.254500 17385 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:56.254911 17385 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:56.255040 17385 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:56.255496 17385 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:56.256438 17385 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:56.256484 17385 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.256539 17385 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:56.256572 17385 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.264626 17385 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.65:36489
I20261118 03:02:56.264707 17512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.65:36489 every 8 connection(s)
I20261118 03:02:56.265612 17385 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/data/info.pb
I20261118 03:02:56.271725 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17385
I20261118 03:02:56.271847 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-0/wal/instance
I20261118 03:02:56.273936 17513 heartbeater.cc:345] Connected to a master server at 127.13.90.126:34735
I20261118 03:02:56.274165 17513 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:56.274710 17513 heartbeater.cc:508] Master 127.13.90.126:34735 requested a full tablet report, sending...
I20261118 03:02:56.274814 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:0
--local_ip_for_outbound_sockets=127.13.90.66
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:56.276403 17325 ts_manager.cc:210] Registered new tserver with Master: 5a9952db455442909f56a0eae1deaf17 (127.13.90.65:36489)
I20261118 03:02:56.277835 17325 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.65:43635
W20261118 03:02:56.374964 17516 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:56.375164 17516 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:56.375203 17516 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:56.375265 17516 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:56.378682 17516 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:56.378734 17516 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:56.378783 17516 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:56.378873 17516 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:56.378909 17516 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:56.382814 17516 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--never_fsync=true
--heap_profile_path=/tmp/kudu.17516
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:56.383548 17516 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:56.384214 17516 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:56.389693 17521 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.389752 17522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.389837 17516 server_base.cc:1061] running on GCE node
W20261118 03:02:56.389696 17524 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.390264 17516 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:56.390767 17516 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:56.391901 17516 hybrid_clock.cc:648] HybridClock initialized: now 1794970976391878 us; error 41 us; skew 500 ppm
I20261118 03:02:56.393569 17516 webserver.cc:577] Webserver started at http://127.13.90.66:44047/ using document root <none> and password file <none>
I20261118 03:02:56.394089 17516 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.394142 17516 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.394309 17516 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:56.395605 17516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/instance:
uuid: "181045240b9b4fc38857881f701625b8"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.395964 17516 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance:
uuid: "181045240b9b4fc38857881f701625b8"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.399036 17516 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.000s	sys 0.004s
I20261118 03:02:56.401299 17530 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.402245 17516 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20261118 03:02:56.402334 17516 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "181045240b9b4fc38857881f701625b8"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.402402 17516 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:56.429894 17516 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:56.430332 17516 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:56.430449 17516 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:56.430971 17516 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:56.431934 17516 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:56.431986 17516 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.432032 17516 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:56.432052 17516 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.440209 17516 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:41433
I20261118 03:02:56.440264 17643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:41433 every 8 connection(s)
I20261118 03:02:56.441242 17516 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 03:02:56.448352 17644 heartbeater.cc:345] Connected to a master server at 127.13.90.126:34735
I20261118 03:02:56.448542 17644 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:56.449021 17644 heartbeater.cc:508] Master 127.13.90.126:34735 requested a full tablet report, sending...
I20261118 03:02:56.450011 17325 ts_manager.cc:210] Registered new tserver with Master: 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:56.450539 17325 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:38633
I20261118 03:02:56.451237 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17516
I20261118 03:02:56.451324 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/instance
I20261118 03:02:56.453374 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.67:0
--local_ip_for_outbound_sockets=127.13.90.67
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
W20261118 03:02:56.552341 17647 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:56.552562 17647 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:56.552608 17647 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:56.552691 17647 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:56.555984 17647 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:56.556033 17647 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:56.556082 17647 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:56.556171 17647 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:56.556206 17647 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.67
I20261118 03:02:56.560055 17647 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
--webserver_interface=127.13.90.67
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--never_fsync=true
--heap_profile_path=/tmp/kudu.17647
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:56.560807 17647 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:56.561471 17647 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:56.566953 17652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.567004 17653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.567003 17655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.567183 17647 server_base.cc:1061] running on GCE node
I20261118 03:02:56.567559 17647 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:56.568082 17647 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:56.569214 17647 hybrid_clock.cc:648] HybridClock initialized: now 1794970976569195 us; error 35 us; skew 500 ppm
I20261118 03:02:56.570715 17647 webserver.cc:577] Webserver started at http://127.13.90.67:43159/ using document root <none> and password file <none>
I20261118 03:02:56.571246 17647 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.571295 17647 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.571511 17647 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:56.572901 17647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/instance:
uuid: "96ff9e25a26440ccad198bc0ad3d9bfe"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.573304 17647 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance:
uuid: "96ff9e25a26440ccad198bc0ad3d9bfe"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.576370 17647 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.002s
I20261118 03:02:56.578693 17661 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.579607 17647 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:56.579707 17647 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
uuid: "96ff9e25a26440ccad198bc0ad3d9bfe"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.579782 17647 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:56.601223 17647 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:56.601634 17647 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:56.601758 17647 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:56.602233 17647 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:56.603134 17647 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:56.603180 17647 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.603233 17647 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:56.603258 17647 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.611495 17647 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.67:35927
I20261118 03:02:56.611601 17774 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.67:35927 every 8 connection(s)
I20261118 03:02:56.612484 17647 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/data/info.pb
I20261118 03:02:56.618256 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17647
I20261118 03:02:56.618363 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/instance
I20261118 03:02:56.619892 17775 heartbeater.cc:345] Connected to a master server at 127.13.90.126:34735
I20261118 03:02:56.620113 17775 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:56.620466 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.68:0
--local_ip_for_outbound_sockets=127.13.90.68
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000 with env {}
I20261118 03:02:56.620538 17775 heartbeater.cc:508] Master 127.13.90.126:34735 requested a full tablet report, sending...
I20261118 03:02:56.621519 17325 ts_manager.cc:210] Registered new tserver with Master: 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67:35927)
I20261118 03:02:56.622045 17325 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.67:33365
W20261118 03:02:56.719080 17778 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:56.719262 17778 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:56.719286 17778 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:56.719348 17778 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:56.722661 17778 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:56.722713 17778 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:56.722746 17778 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:56.722828 17778 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:56.722868 17778 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.68
I20261118 03:02:56.726792 17778 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.68:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
--webserver_interface=127.13.90.68
--webserver_port=0
--tserver_master_addrs=127.13.90.126:34735
--never_fsync=true
--heap_profile_path=/tmp/kudu.17778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.68

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:56.727538 17778 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:56.728222 17778 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:56.733726 17784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.733788 17783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.733964 17786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.734068 17778 server_base.cc:1061] running on GCE node
I20261118 03:02:56.734401 17778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:56.734932 17778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:56.736076 17778 hybrid_clock.cc:648] HybridClock initialized: now 1794970976736060 us; error 29 us; skew 500 ppm
I20261118 03:02:56.737737 17778 webserver.cc:577] Webserver started at http://127.13.90.68:42717/ using document root <none> and password file <none>
I20261118 03:02:56.738271 17778 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.738319 17778 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.738511 17778 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20261118 03:02:56.739739 17778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/instance:
uuid: "2a78b1386ef44fb19377949e4ef81893"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.740166 17778 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance:
uuid: "2a78b1386ef44fb19377949e4ef81893"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.743201 17778 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20261118 03:02:56.745571 17792 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.746477 17778 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:56.746577 17778 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
uuid: "2a78b1386ef44fb19377949e4ef81893"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:56.746656 17778 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:56.762907 17778 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:56.763293 17778 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:56.763418 17778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:56.763868 17778 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:56.764771 17778 ts_tablet_manager.cc:631] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20261118 03:02:56.764816 17778 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.764869 17778 ts_tablet_manager.cc:662] Registered 0 tablets
I20261118 03:02:56.764895 17778 ts_tablet_manager.cc:641] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:56.772706 17778 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.68:32841
I20261118 03:02:56.772732 17905 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.68:32841 every 8 connection(s)
I20261118 03:02:56.773631 17778 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/data/info.pb
I20261118 03:02:56.775786 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17778
I20261118 03:02:56.775895 13673 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/instance
I20261118 03:02:56.780846 17906 heartbeater.cc:345] Connected to a master server at 127.13.90.126:34735
I20261118 03:02:56.781033 17906 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:56.781450 17906 heartbeater.cc:508] Master 127.13.90.126:34735 requested a full tablet report, sending...
I20261118 03:02:56.782348 17325 ts_manager.cc:210] Registered new tserver with Master: 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841)
I20261118 03:02:56.782876 17325 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.68:35275
I20261118 03:02:56.789719 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:56.797266 17325 catalog_manager.cc:2298] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42136:
name: "TestTable"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
owner: "alice"
I20261118 03:02:56.814568 17840 tablet_service.cc:1500] Processing CreateTablet for tablet 4c667f716b2444a8a57be7f48bd785db (DEFAULT_TABLE table=TestTable [id=bca929966fb04eabab873bd7a80fb5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:56.815020 17578 tablet_service.cc:1500] Processing CreateTablet for tablet 4c667f716b2444a8a57be7f48bd785db (DEFAULT_TABLE table=TestTable [id=bca929966fb04eabab873bd7a80fb5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:56.815176 17709 tablet_service.cc:1500] Processing CreateTablet for tablet 4c667f716b2444a8a57be7f48bd785db (DEFAULT_TABLE table=TestTable [id=bca929966fb04eabab873bd7a80fb5fa]), partition=RANGE (key) PARTITION UNBOUNDED
I20261118 03:02:56.815789 17840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c667f716b2444a8a57be7f48bd785db. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:56.815922 17709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c667f716b2444a8a57be7f48bd785db. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:56.815922 17578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c667f716b2444a8a57be7f48bd785db. 1 dirs total, 0 dirs full, 0 dirs failed
I20261118 03:02:56.820888 17923 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Bootstrap starting.
I20261118 03:02:56.821911 17924 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Bootstrap starting.
I20261118 03:02:56.822932 17923 tablet_bootstrap.cc:654] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:56.823709 17924 tablet_bootstrap.cc:654] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:56.823737 17923 log.cc:826] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:56.824357 17925 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Bootstrap starting.
I20261118 03:02:56.824481 17924 log.cc:826] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:56.825178 17923 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: No bootstrap required, opened a new log
I20261118 03:02:56.825388 17923 ts_tablet_manager.cc:1449] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.001s
I20261118 03:02:56.825757 17924 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: No bootstrap required, opened a new log
I20261118 03:02:56.825932 17924 ts_tablet_manager.cc:1449] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Time spent bootstrapping tablet: real 0.004s	user 0.003s	sys 0.000s
I20261118 03:02:56.826516 17925 tablet_bootstrap.cc:654] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Neither blocks nor log segments found. Creating new log.
I20261118 03:02:56.827322 17925 log.cc:826] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Log is configured to *not* fsync() on all Append() calls
I20261118 03:02:56.828294 17924 raft_consensus.cc:360] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.828313 17923 raft_consensus.cc:360] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.828455 17924 raft_consensus.cc:386] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:56.828486 17923 raft_consensus.cc:386] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:56.828505 17924 raft_consensus.cc:748] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181045240b9b4fc38857881f701625b8, State: Initialized, Role: FOLLOWER
I20261118 03:02:56.828552 17923 raft_consensus.cc:748] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a78b1386ef44fb19377949e4ef81893, State: Initialized, Role: FOLLOWER
I20261118 03:02:56.828709 17925 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: No bootstrap required, opened a new log
I20261118 03:02:56.828886 17925 ts_tablet_manager.cc:1449] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20261118 03:02:56.828927 17924 consensus_queue.cc:261] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.828984 17923 consensus_queue.cc:261] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.829620 17924 ts_tablet_manager.cc:1480] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20261118 03:02:56.829948 17644 heartbeater.cc:500] Master 127.13.90.126:34735 was elected leader, sending a full tablet report...
I20261118 03:02:56.830132 17923 ts_tablet_manager.cc:1480] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20261118 03:02:56.830456 17906 heartbeater.cc:500] Master 127.13.90.126:34735 was elected leader, sending a full tablet report...
I20261118 03:02:56.832267 17931 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:56.832391 17931 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.832950 17925 raft_consensus.cc:360] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.833141 17925 raft_consensus.cc:386] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20261118 03:02:56.833192 17925 raft_consensus.cc:748] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96ff9e25a26440ccad198bc0ad3d9bfe, State: Initialized, Role: FOLLOWER
I20261118 03:02:56.833619 17925 consensus_queue.cc:261] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.834232 17775 heartbeater.cc:500] Master 127.13.90.126:34735 was elected leader, sending a full tablet report...
I20261118 03:02:56.835086 17931 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67:35927), 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841)
I20261118 03:02:56.835523 17925 ts_tablet_manager.cc:1480] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20261118 03:02:56.838514 17729 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "181045240b9b4fc38857881f701625b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" is_pre_election: true
I20261118 03:02:56.838713 17729 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181045240b9b4fc38857881f701625b8 in term 0.
I20261118 03:02:56.839394 17533 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181045240b9b4fc38857881f701625b8, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 
I20261118 03:02:56.839638 17929 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20261118 03:02:56.839695 17929 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:56.839748 17929 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:56.840031 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "181045240b9b4fc38857881f701625b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893" is_pre_election: true
I20261118 03:02:56.840240 17860 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 181045240b9b4fc38857881f701625b8 in term 0.
I20261118 03:02:56.840795 17929 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.841059 17929 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [CANDIDATE]: Term 1 election: Requested vote from peers 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67:35927), 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841)
I20261118 03:02:56.841372 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "181045240b9b4fc38857881f701625b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893"
I20261118 03:02:56.841385 17729 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "181045240b9b4fc38857881f701625b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe"
I20261118 03:02:56.841470 17860 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:56.841485 17729 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 0 FOLLOWER]: Advancing to term 1
I20261118 03:02:56.842211 17729 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181045240b9b4fc38857881f701625b8 in term 1.
I20261118 03:02:56.842437 17533 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 181045240b9b4fc38857881f701625b8, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 
W20261118 03:02:56.842485 17645 tablet.cc:2441] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20261118 03:02:56.842587 17929 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 FOLLOWER]: Leader election won for term 1
I20261118 03:02:56.842665 17929 raft_consensus.cc:705] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 LEADER]: Becoming Leader. State: Replica: 181045240b9b4fc38857881f701625b8, State: Running, Role: LEADER
I20261118 03:02:56.842702 17860 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 181045240b9b4fc38857881f701625b8 in term 1.
I20261118 03:02:56.842960 17929 consensus_queue.cc:238] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:56.845804 17324 catalog_manager.cc:5840] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 181045240b9b4fc38857881f701625b8 (127.13.90.66). New cstate: current_term: 1 leader_uuid: "181045240b9b4fc38857881f701625b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } health_report { overall_health: HEALTHY } } }
I20261118 03:02:56.846279 17929 consensus_queue.cc:1049] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:56.846865 17929 consensus_queue.cc:1049] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20261118 03:02:56.858464 13673 external_mini_cluster.cc:955] 4 TS(s) registered with all masters
I20261118 03:02:56.859753 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 181045240b9b4fc38857881f701625b8 to finish bootstrapping
I20261118 03:02:56.864521 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 96ff9e25a26440ccad198bc0ad3d9bfe to finish bootstrapping
I20261118 03:02:56.868868 13673 ts_itest-base.cc:246] Waiting for 1 tablets on tserver 2a78b1386ef44fb19377949e4ef81893 to finish bootstrapping
I20261118 03:02:56.873365 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17516
I20261118 03:02:56.879405 13673 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
/tmp/dist-test-taskITJK_Y/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.13.90.66:41433
--local_ip_for_outbound_sockets=127.13.90.66
--tserver_master_addrs=127.13.90.126:34735
--webserver_port=44047
--webserver_interface=127.13.90.66
--builtin_ntp_servers=127.13.90.84:37575
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_cache_size_limit_mb=1
--log_segment_size_mb=1
--log_async_preallocate_segments=false
--log_min_segments_to_retain=1
--log_max_segments_to_retain=3
--maintenance_manager_polling_interval_ms=100
--log_target_replay_size_mb=1
--max_cell_size_bytes=1000000
--tablet_bootstrap_inject_latency_ms=3000 with env {}
W20261118 03:02:56.976442 17942 flags.cc:432] Enabled unsafe flag: --max_cell_size_bytes=1000000
W20261118 03:02:56.976640 17942 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20261118 03:02:56.976688 17942 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20261118 03:02:56.976753 17942 flags.cc:432] Enabled unsafe flag: --tablet_bootstrap_inject_latency_ms=3000
W20261118 03:02:56.976783 17942 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20261118 03:02:56.980147 17942 flags.cc:432] Enabled experimental flag: --log_compression_codec=no_compression
W20261118 03:02:56.980195 17942 flags.cc:432] Enabled experimental flag: --log_max_segments_to_retain=3
W20261118 03:02:56.980227 17942 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20261118 03:02:56.980314 17942 flags.cc:432] Enabled experimental flag: --log_target_replay_size_mb=1
W20261118 03:02:56.980355 17942 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.13.90.66
I20261118 03:02:56.984229 17942 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.13.90.84:37575
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--max_cell_size_bytes=1000000
--follower_unavailable_considered_failed_sec=3
--log_compression_codec=no_compression
--log_max_segments_to_retain=3
--log_cache_size_limit_mb=1
--log_async_preallocate_segments=false
--log_segment_size_mb=1
--fs_data_dirs=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.13.90.66:41433
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
--webserver_interface=127.13.90.66
--webserver_port=44047
--tserver_master_addrs=127.13.90.126:34735
--tablet_bootstrap_inject_latency_ms=3000
--never_fsync=true
--heap_profile_path=/tmp/kudu.17942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--log_target_replay_size_mb=1
--maintenance_manager_polling_interval_ms=100
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.13.90.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 3458f03c6ee765ff81fe1ff179b7d6d82b82420b
build type DEBUG
built by None at 18 Nov 2026 02:43:13 UTC on bdcb31816ec0
build id 14835
I20261118 03:02:56.984956 17942 env_posix.cc:2314] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20261118 03:02:56.985641 17942 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20261118 03:02:56.991106 17950 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.991134 17948 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20261118 03:02:56.991163 17947 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20261118 03:02:56.991374 17942 server_base.cc:1061] running on GCE node
I20261118 03:02:56.991725 17942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20261118 03:02:56.992260 17942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20261118 03:02:56.993408 17942 hybrid_clock.cc:648] HybridClock initialized: now 1794970976993389 us; error 32 us; skew 500 ppm
I20261118 03:02:56.994917 17942 webserver.cc:577] Webserver started at http://127.13.90.66:44047/ using document root <none> and password file <none>
I20261118 03:02:56.995436 17942 fs_manager.cc:362] Metadata directory not provided
I20261118 03:02:56.995509 17942 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20261118 03:02:56.998770 17942 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20261118 03:02:57.000813 17956 log_block_manager.cc:4130] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20261118 03:02:57.001752 17942 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20261118 03:02:57.001852 17942 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
uuid: "181045240b9b4fc38857881f701625b8"
format_stamp: "Formatted at 2026-11-18 03:02:56 on dist-test-slave-m226"
I20261118 03:02:57.002197 17942 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
metadata directory: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal
1 data directories: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20261118 03:02:57.013747 17942 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20261118 03:02:57.014153 17942 env_posix.cc:2314] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20261118 03:02:57.014302 17942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20261118 03:02:57.014777 17942 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20261118 03:02:57.015852 17963 ts_tablet_manager.cc:588] Loading tablet metadata (0/1 complete)
I20261118 03:02:57.019308 17942 ts_tablet_manager.cc:631] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20261118 03:02:57.019369 17942 ts_tablet_manager.cc:577] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20261118 03:02:57.019441 17942 ts_tablet_manager.cc:646] Registering tablets (0/1 complete)
I20261118 03:02:57.021162 17942 ts_tablet_manager.cc:662] Registered 1 tablets
I20261118 03:02:57.021205 17942 ts_tablet_manager.cc:641] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
W20261118 03:02:57.021214 17963 ts_tablet_manager.cc:1428] Injecting 3000ms delay in tablet bootstrapping
I20261118 03:02:57.029624 17942 rpc_server.cc:307] RPC server started. Bound to: 127.13.90.66:41433
I20261118 03:02:57.029664 18070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.13.90.66:41433 every 8 connection(s)
I20261118 03:02:57.030622 17942 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/data/info.pb
I20261118 03:02:57.034312 13673 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu as pid 17942
I20261118 03:02:57.039340 18071 heartbeater.cc:345] Connected to a master server at 127.13.90.126:34735
I20261118 03:02:57.039557 18071 heartbeater.cc:462] Registering TS with master...
I20261118 03:02:57.040335 18071 heartbeater.cc:508] Master 127.13.90.126:34735 requested a full tablet report, sending...
I20261118 03:02:57.041798 17323 ts_manager.cc:210] Re-registered known tserver with Master: 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:57.042755 17323 master_service.cc:507] Signed X509 certificate for tserver {username='slave'} at 127.13.90.66:60055
I20261118 03:02:57.279835 17513 heartbeater.cc:500] Master 127.13.90.126:34735 was elected leader, sending a full tablet report...
I20261118 03:02:58.044518 18071 heartbeater.cc:500] Master 127.13.90.126:34735 was elected leader, sending a full tablet report...
I20261118 03:02:58.350658 18076 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181045240b9b4fc38857881f701625b8)
I20261118 03:02:58.350785 18076 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:58.351788 18077 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 181045240b9b4fc38857881f701625b8)
I20261118 03:02:58.351897 18077 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:58.352314 18076 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67:35927), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:58.354017 18077 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:58.356356 17729 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "2a78b1386ef44fb19377949e4ef81893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" is_pre_election: true
I20261118 03:02:58.356487 17729 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2a78b1386ef44fb19377949e4ef81893 in term 1.
I20261118 03:02:58.356891 17795 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a78b1386ef44fb19377949e4ef81893, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 
I20261118 03:02:58.357014 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893" is_pre_election: true
I20261118 03:02:58.357113 17860 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ff9e25a26440ccad198bc0ad3d9bfe in term 1.
I20261118 03:02:58.357218 18076 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 03:02:58.357416 17664 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a78b1386ef44fb19377949e4ef81893, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 
I20261118 03:02:58.357622 18076 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181045240b9b4fc38857881f701625b8)
I20261118 03:02:58.357620 18077 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Leader pre-election won for term 2
I20261118 03:02:58.357676 18077 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Starting leader election (detected failure of leader 181045240b9b4fc38857881f701625b8)
I20261118 03:02:58.357679 18076 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:58.357708 18077 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 1 FOLLOWER]: Advancing to term 2
I20261118 03:02:58.356822 18025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "2a78b1386ef44fb19377949e4ef81893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8" is_pre_election: true
W20261118 03:02:58.358502 17794 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:58.358817 18076 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:58.358862 18077 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:58.358892 18025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8" is_pre_election: true
I20261118 03:02:58.359163 18076 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 election: Requested vote from peers 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67:35927), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:58.359396 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893"
I20261118 03:02:58.359413 18077 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 election: Requested vote from peers 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
W20261118 03:02:58.359443 17663 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:58.359537 17860 raft_consensus.cc:2415] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 96ff9e25a26440ccad198bc0ad3d9bfe in current term 2: Already voted for candidate 2a78b1386ef44fb19377949e4ef81893 in this term.
I20261118 03:02:58.359740 17729 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "2a78b1386ef44fb19377949e4ef81893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe"
I20261118 03:02:58.359799 18025 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "2a78b1386ef44fb19377949e4ef81893" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8"
I20261118 03:02:58.359876 17729 raft_consensus.cc:2415] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2a78b1386ef44fb19377949e4ef81893 in current term 2: Already voted for candidate 96ff9e25a26440ccad198bc0ad3d9bfe in this term.
I20261118 03:02:58.359992 18024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8"
W20261118 03:02:58.360090 17794 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:58.360203 17795 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2a78b1386ef44fb19377949e4ef81893; no voters: 181045240b9b4fc38857881f701625b8, 96ff9e25a26440ccad198bc0ad3d9bfe
W20261118 03:02:58.360241 17663 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:58.360303 17663 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 181045240b9b4fc38857881f701625b8, 2a78b1386ef44fb19377949e4ef81893
I20261118 03:02:58.360368 18076 raft_consensus.cc:2771] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20261118 03:02:58.360483 18077 raft_consensus.cc:2771] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20261118 03:02:59.898518 18086 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20261118 03:02:59.898653 18086 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:59.899067 18086 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:59.899451 18024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8" is_pre_election: true
I20261118 03:02:59.899466 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893" is_pre_election: true
I20261118 03:02:59.899590 17860 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 96ff9e25a26440ccad198bc0ad3d9bfe in term 2.
W20261118 03:02:59.899863 17663 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:59.899987 17664 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a78b1386ef44fb19377949e4ef81893, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 181045240b9b4fc38857881f701625b8
I20261118 03:02:59.900142 18086 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Leader pre-election won for term 3
I20261118 03:02:59.900202 18086 raft_consensus.cc:499] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20261118 03:02:59.900238 18086 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 2 FOLLOWER]: Advancing to term 3
I20261118 03:02:59.901114 18086 raft_consensus.cc:521] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:59.901409 18086 leader_election.cc:290] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 election: Requested vote from peers 2a78b1386ef44fb19377949e4ef81893 (127.13.90.68:32841), 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433)
I20261118 03:02:59.901700 17860 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2a78b1386ef44fb19377949e4ef81893"
I20261118 03:02:59.901762 18024 tablet_service.cc:1906] Received RequestConsensusVote() RPC: tablet_id: "4c667f716b2444a8a57be7f48bd785db" candidate_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "181045240b9b4fc38857881f701625b8"
I20261118 03:02:59.901808 17860 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 2 FOLLOWER]: Advancing to term 3
W20261118 03:02:59.902088 17663 leader_election.cc:343] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Illegal state: must be running to vote when last-logged opid is not known
I20261118 03:02:59.902629 17860 raft_consensus.cc:2490] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 96ff9e25a26440ccad198bc0ad3d9bfe in term 3.
I20261118 03:02:59.902868 17664 leader_election.cc:304] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2a78b1386ef44fb19377949e4ef81893, 96ff9e25a26440ccad198bc0ad3d9bfe; no voters: 181045240b9b4fc38857881f701625b8
I20261118 03:02:59.903017 18086 raft_consensus.cc:2826] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 3 FOLLOWER]: Leader election won for term 3
I20261118 03:02:59.903173 18086 raft_consensus.cc:705] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [term 3 LEADER]: Becoming Leader. State: Replica: 96ff9e25a26440ccad198bc0ad3d9bfe, State: Running, Role: LEADER
I20261118 03:02:59.903491 18086 consensus_queue.cc:238] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:02:59.905419 17860 raft_consensus.cc:1285] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893 [term 3 FOLLOWER]: Refusing update from remote peer 96ff9e25a26440ccad198bc0ad3d9bfe: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20261118 03:02:59.905853 18087 consensus_queue.cc:1049] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20261118 03:02:59.906044 17325 catalog_manager.cc:5840] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe reported cstate change: term changed from 1 to 3, leader changed from 181045240b9b4fc38857881f701625b8 (127.13.90.66) to 96ff9e25a26440ccad198bc0ad3d9bfe (127.13.90.67). New cstate: current_term: 3 leader_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } health_report { overall_health: UNKNOWN } } }
W20261118 03:02:59.906175 17663 consensus_peers.cc:597] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe -> Peer 181045240b9b4fc38857881f701625b8 (127.13.90.66:41433): Couldn't send request to peer 181045240b9b4fc38857881f701625b8. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20261118 03:03:00.021703 17963 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Bootstrap starting.
I20261118 03:03:00.028405 17963 log.cc:826] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Log is configured to *not* fsync() on all Append() calls
I20261118 03:03:00.030925 17963 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20261118 03:03:00.031260 17963 tablet_bootstrap.cc:492] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Bootstrap complete.
I20261118 03:03:00.031683 17963 ts_tablet_manager.cc:1449] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Time spent bootstrapping tablet: real 0.010s	user 0.007s	sys 0.000s
I20261118 03:03:00.033916 17963 raft_consensus.cc:360] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:03:00.034263 17963 raft_consensus.cc:748] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 181045240b9b4fc38857881f701625b8, State: Initialized, Role: FOLLOWER
I20261118 03:03:00.034754 17963 consensus_queue.cc:261] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "96ff9e25a26440ccad198bc0ad3d9bfe" member_type: VOTER last_known_addr { host: "127.13.90.67" port: 35927 } } peers { permanent_uuid: "2a78b1386ef44fb19377949e4ef81893" member_type: VOTER last_known_addr { host: "127.13.90.68" port: 32841 } } peers { permanent_uuid: "181045240b9b4fc38857881f701625b8" member_type: VOTER last_known_addr { host: "127.13.90.66" port: 41433 } }
I20261118 03:03:00.035478 17963 ts_tablet_manager.cc:1480] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20261118 03:03:00.311192 18024 raft_consensus.cc:3096] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8 [term 1 FOLLOWER]: Advancing to term 3
I20261118 03:03:00.696909 13673 test_workload.cc:405] TestWorkload: Skipping table creation because table TestTable already exists
I20261118 03:03:00.697198 13673 raft_config_change-itest.cc:610] Waiting until we've written at least 4MB...
I20261118 03:03:00.787084 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling FlushMRSOp(4c667f716b2444a8a57be7f48bd785db): 2892876 bytes log retention, and flush 5079305 bytes memory
I20261118 03:03:00.822728 13673 raft_config_change-itest.cc:616] Waiting for log GC on 96ff9e25a26440ccad198bc0ad3d9bfe
I20261118 03:03:00.827173 17776 maintenance_manager.cc:419] P 96ff9e25a26440ccad198bc0ad3d9bfe: Scheduling FlushMRSOp(4c667f716b2444a8a57be7f48bd785db): 4602388 bytes log retention, and flush 6119689 bytes memory
I20261118 03:03:00.836879 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: FlushMRSOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.049s	user 0.047s	sys 0.000s Metrics: {"bytes_written":135937,"cfile_init":1,"compiler_manager_pool.queue_time_us":12043,"drs_written":1,"lbm_read_time_us":62,"lbm_reads_lt_1ms":4,"lbm_write_time_us":586,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":27,"thread_start_us":223,"threads_started":2}
I20261118 03:03:00.837736 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 2892876 bytes of WAL
I20261118 03:03:00.838013 17797 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 4 log segments from log reader
I20261118 03:03:00.838138 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000001 (ops 1-8)
I20261118 03:03:00.838243 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000002 (ops 9-12)
I20261118 03:03:00.838310 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000003 (ops 13-17)
I20261118 03:03:00.838370 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000004 (ops 18-24)
I20261118 03:03:00.839326 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:03:00.839593 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling FlushMRSOp(4c667f716b2444a8a57be7f48bd785db): 1709383 bytes log retention, and flush 1958153 bytes memory
I20261118 03:03:00.840353 18072 maintenance_manager.cc:419] P 181045240b9b4fc38857881f701625b8: Scheduling FlushMRSOp(4c667f716b2444a8a57be7f48bd785db): 4076280 bytes log retention, and flush 6119689 bytes memory
I20261118 03:03:00.858095 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: FlushMRSOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.018s	user 0.016s	sys 0.000s Metrics: {"bytes_written":135803,"cfile_init":1,"dirs.queue_time_us":39,"dirs.run_cpu_time_us":141,"dirs.run_wall_time_us":1325,"drs_written":1,"lbm_read_time_us":43,"lbm_reads_lt_1ms":4,"lbm_write_time_us":501,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":10}
I20261118 03:03:00.859051 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 920424 bytes of WAL
I20261118 03:03:00.859279 17797 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 1 log segments from log reader
I20261118 03:03:00.859349 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000005 (ops 25-31)
I20261118 03:03:00.859735 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:03:00.859989 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db): 697 bytes on disk
I20261118 03:03:00.860635 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":2,"lbm_read_time_us":93,"lbm_reads_lt_1ms":8}
I20261118 03:03:00.861084 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling CompactRowSetsOp(4c667f716b2444a8a57be7f48bd785db): perf score=1.002206
I20261118 03:03:00.889408 17666 maintenance_manager.cc:643] P 96ff9e25a26440ccad198bc0ad3d9bfe: FlushMRSOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.062s	user 0.061s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":243,"drs_written":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4,"lbm_write_time_us":567,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":37,"thread_start_us":278,"threads_started":2}
I20261118 03:03:00.890228 17776 maintenance_manager.cc:419] P 96ff9e25a26440ccad198bc0ad3d9bfe: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 4602388 bytes of WAL
I20261118 03:03:00.890489 17666 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 5 log segments from log reader
I20261118 03:03:00.890574 17666 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000001 (ops 1-9)
I20261118 03:03:00.890650 17666 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000002 (ops 10-16)
I20261118 03:03:00.890698 17666 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000003 (ops 17-23)
I20261118 03:03:00.890748 17666 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000004 (ops 24-30)
I20261118 03:03:00.890794 17666 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 96ff9e25a26440ccad198bc0ad3d9bfe: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-2/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000005 (ops 31-37)
I20261118 03:03:00.892122 17666 maintenance_manager.cc:643] P 96ff9e25a26440ccad198bc0ad3d9bfe: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.002s	user 0.001s	sys 0.000s Metrics: {}
I20261118 03:03:00.892428 17776 maintenance_manager.cc:419] P 96ff9e25a26440ccad198bc0ad3d9bfe: Scheduling UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db): 555 bytes on disk
I20261118 03:03:00.892961 17666 maintenance_manager.cc:643] P 96ff9e25a26440ccad198bc0ad3d9bfe: UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4}
I20261118 03:03:00.899822 13673 raft_config_change-itest.cc:620] Log GC complete on 96ff9e25a26440ccad198bc0ad3d9bfe
I20261118 03:03:00.922302 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: CompactRowSetsOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.061s	user 0.042s	sys 0.008s Metrics: {"bytes_written":136001,"cfile_cache_hit":10,"cfile_cache_hit_bytes":262394,"cfile_cache_miss":26,"cfile_cache_miss_bytes":264466,"cfile_init":5,"delta_iterators_relevant":4,"dirs.queue_time_us":1439,"dirs.run_cpu_time_us":393,"dirs.run_wall_time_us":2574,"drs_written":1,"lbm_read_time_us":636,"lbm_reads_lt_1ms":46,"lbm_write_time_us":566,"lbm_writes_lt_1ms":23,"mutex_wait_us":917,"num_input_rowsets":2,"peak_mem_usage":65536,"rows_written":37,"spinlock_wait_cycles":3251456,"thread_start_us":275,"threads_started":4}
I20261118 03:03:00.922912 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db): 555 bytes on disk
I20261118 03:03:00.923880 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":46,"lbm_reads_lt_1ms":4}
I20261118 03:03:00.942397 17961 maintenance_manager.cc:643] P 181045240b9b4fc38857881f701625b8: FlushMRSOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.102s	user 0.060s	sys 0.000s Metrics: {"bytes_written":136001,"cfile_init":1,"compiler_manager_pool.queue_time_us":27106,"drs_written":1,"lbm_read_time_us":66,"lbm_reads_lt_1ms":4,"lbm_write_time_us":606,"lbm_writes_lt_1ms":23,"peak_mem_usage":0,"rows_written":37,"thread_start_us":210,"threads_started":2}
I20261118 03:03:00.943248 18072 maintenance_manager.cc:419] P 181045240b9b4fc38857881f701625b8: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 3155872 bytes of WAL
I20261118 03:03:00.943511 17961 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 4 log segments from log reader
I20261118 03:03:00.943612 17961 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000001 (ops 1-8)
I20261118 03:03:00.943737 17961 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000002 (ops 9-13)
I20261118 03:03:00.943819 17961 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000003 (ops 14-20)
I20261118 03:03:00.943892 17961 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000004 (ops 21-26)
I20261118 03:03:00.944936 17961 maintenance_manager.cc:643] P 181045240b9b4fc38857881f701625b8: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.002s	user 0.000s	sys 0.001s Metrics: {}
I20261118 03:03:00.945243 18072 maintenance_manager.cc:419] P 181045240b9b4fc38857881f701625b8: Scheduling UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db): 555 bytes on disk
I20261118 03:03:00.945791 17961 maintenance_manager.cc:643] P 181045240b9b4fc38857881f701625b8: UndoDeltaBlockGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":56,"lbm_reads_lt_1ms":4}
I20261118 03:03:01.426316 17907 maintenance_manager.cc:419] P 2a78b1386ef44fb19377949e4ef81893: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 788959 bytes of WAL
I20261118 03:03:01.426596 17797 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 1 log segments from log reader
I20261118 03:03:01.426656 17797 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 2a78b1386ef44fb19377949e4ef81893: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-3/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000006 (ops 32-37)
I20261118 03:03:01.426928 17797 maintenance_manager.cc:643] P 2a78b1386ef44fb19377949e4ef81893: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20261118 03:03:01.447911 18072 maintenance_manager.cc:419] P 181045240b9b4fc38857881f701625b8: Scheduling LogGCOp(4c667f716b2444a8a57be7f48bd785db): free 920408 bytes of WAL
I20261118 03:03:01.448132 17961 log_reader.cc:385] T 4c667f716b2444a8a57be7f48bd785db: removed 1 log segments from log reader
I20261118 03:03:01.448179 17961 log.cc:1079] T 4c667f716b2444a8a57be7f48bd785db P 181045240b9b4fc38857881f701625b8: Deleting log segment in path: /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0/raft_consensus-itest-cluster/ts-1/wal/wals/4c667f716b2444a8a57be7f48bd785db/wal-000000005 (ops 27-33)
I20261118 03:03:01.448455 17961 maintenance_manager.cc:643] P 181045240b9b4fc38857881f701625b8: LogGCOp(4c667f716b2444a8a57be7f48bd785db) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/integration-tests/raft_config_change-itest.cc:500: Failure
Value of: IsRaftConfigMember(added_replica_uuid, cstate.committed_config())
  Actual: false
Expected: true
/home/jenkins-slave/workspace/build_and_test_flaky/src/kudu/util/test_util.cc:402: Failure
Failed
Timed out waiting for assertion to pass.
I20261118 03:03:31.050331 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17385
I20261118 03:03:31.055728 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17942
I20261118 03:03:31.061204 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17647
I20261118 03:03:31.066637 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17778
I20261118 03:03:31.072268 13673 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskITJK_Y/build/debug/bin/kudu with pid 17294
2026-11-18T03:03:31Z chronyd exiting
I20261118 03:03:31.088557 13673 test_util.cc:182] -----------------------------------------------
I20261118 03:03:31.088613 13673 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskITJK_Y/test-tmp/raft_config_change-itest.0.SlowTabletBootstrapTest.TestFallBehindSlowBootstrap.1794970948883749-13673-0
[  FAILED  ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap (35213 ms)
[----------] 3 tests from SlowTabletBootstrapTest (48624 ms total)

[----------] Global test environment tear-down
[==========] 6 tests from 2 test suites ran. (62195 ms total)
[  PASSED  ] 5 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] SlowTabletBootstrapTest.TestFallBehindSlowBootstrap

 1 FAILED TEST